Information processing apparatus and non-transitory computer readable medium

ABSTRACT

An information processing apparatus includes a controller. When a device that changes an image presented in a field of view of a user along with a motion direction of the user receives an output instruction, the controller performs a control to output an image including a presentation image of an area being presented to the user at a time when the output instruction is received and a user&#39;s own image.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based on and claims priority under 35 USC 119 fromJapanese Patent Application No. 2017-236582 filed Dec. 11, 2017.

BACKGROUND Technical Field

The present invention relates to an information processing apparatus anda non-transitory computer readable medium.

SUMMARY

According to an aspect of the present disclosure, an informationprocessing apparatus includes a controller. When a device that changesan image presented in a field of view of a user along with a motiondirection of the user receives an output instruction, the controllerperforms a control to output an image including a presentation image ofan area being presented to the user at a time when the outputinstruction is received and a user's own image.

BRIEF DESCRIPTION OF THE DRAWINGS

Exemplary embodiment(s) of the present invention will be described indetail based on the following figures, wherein:

FIG. 1 is a conceptual module configuration diagram of an example of theconfiguration of an exemplary embodiment;

FIG. 2 is an explanatory view of an example of the system configurationusing the exemplary embodiment;

FIG. 3 is a conceptual module configuration diagram of an example of theconfiguration of an image presentation module;

FIG. 4 is a flowchart illustrating an example of a process according tothe exemplary embodiment;

FIG. 5 is a flowchart illustrating an example of a process according tothe exemplary embodiment;

FIG. 6 is a flowchart illustrating an example of a process according tothe exemplary embodiment;

FIG. 7 is a flowchart illustrating an example of a process according tothe exemplary embodiment;

FIG. 8 is a flowchart illustrating an example of a process according tothe exemplary embodiment;

FIGS. 9A and 9B are flowcharts illustrating an example of a processaccording to the exemplary embodiment;

FIGS. 10A and 10B are flowcharts illustrating an example of a processaccording to the exemplary embodiment;

FIGS. 11A to 11C are explanatory views illustrating examples ofpresentation of a screen according to the exemplary embodiment;

FIG. 12 is a flowchart illustrating an example of a process according tothe exemplary embodiment;

FIG. 13 is an explanatory view illustrating an example of a processaccording to the exemplary embodiment;

FIG. 14 is an explanatory view illustrating an example of the datastructure of a user image table;

FIG. 15 is an explanatory view illustrating an example of the datastructure of a target image table;

FIG. 16 is an explanatory view illustrating an example of the datastructure of a combination result table;

FIG. 17 is an explanatory view illustrating an example of the datastructure of a user image table;

FIG. 18 is an explanatory view illustrating an example of a datastructure of a combination result table;

FIG. 19 is a flowchart illustrating an example of a process according tothe exemplary embodiment;

FIG. 20 is an explanatory view illustrating an example of a processaccording to the exemplary embodiment;

FIG. 21 is a flowchart illustrating an example of a process according tothe exemplary embodiment;

FIG. 22 is an explanatory view illustrating an example of a processaccording to the exemplary embodiment;

FIG. 23 is a flowchart illustrating an example of a process according tothe exemplary embodiment;

FIG. 24 is a flowchart illustrating an example of a process according tothe exemplary embodiment;

FIG. 25 is a flowchart illustrating an example of a process according tothe exemplary embodiment;

FIG. 26 is an explanatory view illustrating an example of the datastructure of a printing target image table;

FIG. 27 is an explanatory view illustrating an example of the datastructure of a three-dimensional object data file;

FIG. 28 is an explanatory view illustrating an example of the datastructure of a printer attribute table;

FIGS. 29A to 29C are explanatory views illustrating examples of aprocess according to the exemplary embodiment;

FIGS. 30A to 30C are explanatory views illustrating examples of aprocess according to the exemplary embodiment;

FIG. 30D is an explanatory view illustrating an example of a processaccording to the exemplary embodiment;

FIG. 31 is a conceptual module configuration diagram of an example ofthe configuration of an image formation instruction module;

FIG. 32 is a flowchart illustrating an example of a process according tothe exemplary embodiment;

FIG. 33 is a flowchart illustrating an example of a process according tothe exemplary embodiment;

FIGS. 34A to 34C are explanatory views illustrating examples of an outeredge of a process target according to the exemplary embodiment;

FIG. 35 are an explanatory view illustrating an example of presentationof a screen according to the exemplary embodiment;

FIG. 36 is an explanatory view illustrating an example of thepresentation of the screen according to the exemplary embodiment;

FIG. 37 is an explanatory view illustrating an example of the datastructure of a printing instruction table;

FIG. 38 is a conceptual module configuration diagram of an example ofthe configuration of a two-dimensional printer;

FIG. 39 is a view schematically illustrating the configuration in animage forming process module;

FIG. 40 is a view illustrating the configuration in the vicinity of aposition where a secondary transfer is performed by the image formingprocess module, and the configuration to control a bias voltage appliedbetween a secondary transfer member and a cleaning member;

FIGS. 41A to 41C are views for explaining a state where a contaminationoccurs on the back surface of a recording medium due to a toner imageformed to extend outward from the recording medium in a borderlessprinting;

FIG. 42 is a flowchart illustrating an example of a process according tothe exemplary embodiment;

FIGS. 43A and 43B are explanatory views illustrating an example of aprocess according to the exemplary embodiment;

FIG. 44 is a flowchart illustrating an example of a process according tothe exemplary embodiment;

FIG. 45 is an explanatory view illustrating an example of the datastructure of a borderless printing log table;

FIG. 46 is an explanatory view illustrating an example of the datastructure of a per-user permitted number of copies table;

FIG. 47 is a flowchart illustrating an example of a process according tothe exemplary embodiment;

FIG. 48 is a flowchart illustrating an example of a process according tothe exemplary embodiment;

FIG. 49 is a flowchart illustrating an example of a process according tothe exemplary embodiment; and

FIG. 50 is a block diagram illustrating an example of the hardwareconfiguration of a computer for implementing the exemplary embodiment.

DETAILED DESCRIPTION

Hereinafter, an exemplary embodiment of the present disclosure will bedescribed with reference to the accompanying drawings.

FIG. 1 illustrates a conceptual module configuration diagram of anexample of the configuration of the exemplary embodiment.

In general, modules refer to logically separable components of, forexample, software (computer program) or hardware. Accordingly, modulesin the present exemplary embodiment indicate not only modules in acomputer program but also modules in a hardware configuration. Thus, thedescription of the present exemplary embodiment also include adescription of a computer program that causes a computer to function asthose modules (a program that causes a computer to execute respectiveprocesses, a program that causes a computer to function as respectiveunits, or a program that causes a computer to implement the respectivefunctions), a system, and a method. For the convenience of thedescription, the expressions “store,” “caused to store,” and equivalentexpressions thereto will be used. When the present exemplary embodimentis a computer program, these expressions mean storing something in astorage device or performing a control to store something in a storagedevice. In addition, one module may correspond to one function. Inimplementation, however, one module may be configured with one program,plural modules may be configured with one program, or in reverse, onemodule may be configured with plural programs. Further, plural modulesmay be executed by one computer, or one module may be executed by pluralcomputers in a distributed or parallel environment. In addition, onemodule may include another module. In addition, hereinafter, the term“connection” is used in a case of a logical connection as well (e.g.,data exchange, instructions, a reference relationship among data, andlogin), in addition to a physical connection. The term “predetermined”refers to being determined prior to a target process. The term“predetermined” includes the meaning of being determined according to acircumstance/state at or until a specific time point not only before aprocess according to the present exemplary embodiment is started, butalso prior to the target process even after the process according to thepresent exemplary embodiment is started. When plural “predeterminedvalues” exist, the values may be different from each other, or two ormore of the values (including all of the values) may be identical toeach other. In addition, the description “when it is A, B is performed”means that “it is determined whether it is A or not, and when it isdetermined that it is A, B is performed,” except for a case where thedetermination of whether it is A or not is unnecessary. In addition,when items are enumerated like “A, B, and C,” the enumeration is merelyexemplary and includes a case of selecting only one of the items (e.g.,only A), unless otherwise specified.

In addition, a system or an apparatus includes the configurationimplemented by, for example, one computer, one hardware component, orone device as well, in addition to the configuration in which, forexample, plural computers, plural hardware components, or plural devicesare connected to each other by a communication unit such as a network(including a one-to-one corresponding communication connection). Theterms “apparatus” and “system” are used as synonyms. The “system” doesnot include a system merely meaning a social “structure” (social system)which is an artificial engagement.

In addition, target information is read from a memory device per processwhich is performed by each module or for each process in a case whereplural processes are performed in a module. After the process isexecuted, the process result is written in a storage device. Thus, thedescription of the reading from the storage device prior to the processand the writing in the storage device after the process may be omitted.In addition, examples of the storage device may include a hard disk, arandom access memory (RAM), an external storage medium, a storage devicethrough a communication line, and a register in a central processingunit (CPU).

An information processing apparatus 100 of the present exemplaryembodiment enables an output of an image when a device that changes apresented image along with a motion direction of a user receives anoutput instruction. As in the example illustrated in FIG. 1, theinformation processing apparatus 100 includes a movement detectionmodule 105, an image storage module 110A, a user image storage module110B, an image presentation module 115, an output instruction receptionmodule 120, an output control module 125, and an output image outputtingmodule 130.

The “device that changes a presented image along with a motion directionof a user” is, for example, a head mounted display. The head mounteddisplay refers to a display which is used in a state of being mounted ona head, such as a goggle, a helmet, or eye glasses. The head mounteddisplay is also called “smart glasses.”

The virtual reality (VR) is a technology which artificially generatesrealistic environments to interact with the human sensory organs, and isimplemented by a system which displays images generated by a computer inreal time on the head mounted display.

In addition, the phrase “along with a motion direction of a user” refersto detecting a movement of, for example, a user's body such as theuser's head or a user's gaze and reflecting the detection result on thedisplay.

The movement detection module 105 is connected to the image presentationmodule 115. The movement detection module 105 detects a motion of theuser. As described above, the movement detection module 105 detects amovement of the user's body such as the head or the user's gaze.

The image storage module 110A is connected to the image presentationmodule 115 and the output control module 125. The image storage module110A stores an image that can be presented in the field of view of theuser. The image storage module 110A stores data such as a moving image,a still image, a three-dimensional image, and audio. Specifically, theimage storage module 110A stores a 360-degree surrounding image at eachtime. It is noted that the stored images do not necessarily show360-degree surroundings. That is, even a case where images ofsurroundings only up to a specific angle are prepared satisfies the“device that changes a presented image along with a motion direction ofa user” in the present disclosure. When the image of surroundings can beswitched and displayed only up to the specific angle, a control processmay be performed such that no image exists or image switching is notperformed beyond the specific angle. In addition, when, for example, amoving image, a still image, a three-dimensional image, or audio of anobject to be output is not associated with a play time (i.e., when thereis no association between the object to be output and a play time), theobject that is being played is specified only according to the angle,and the process of the present exemplary embodiment is performedaccording to the user's motion direction and the user's outputinstruction of at that time.

The user image storage module 110B is connected to the output controlmodule 125. The user image storage module 110B stores an image of theuser. The image of the user is, for example, an image obtained bycapturing the entire body of the user (which may includethree-dimensional data), or an image obtained by capturing the face ofthe user (which may include three-dimensional data). As for the user, inaddition to the image of the user who is using the informationprocessing apparatus 100, an image of another user may be stored. Asdescribed later, the image of the other user may be a user image ofanother user who is using the same contents as the contents beingprocessed in the information processing apparatus 100, or a user imageof another user present near the user who is using the informationprocessing apparatus 100. Specifically, for example, a user image table1400 to be described later using an example of FIG. 14 is stored.

The image presentation module 115 is connected to the movement detectionmodule 105, the image storage module 110A, and the output control module125. The image presentation module 115 changes an image presented in thefield of view of the user, along with the motion of the user detected bythe movement detection module 105.

In the VR, an image located in the 360-degree directions is displayedaccording to each scene of application software. That is, when X minuteselapse from the start of the application software, a 360-degreesurrounding image for a scene after the X minutes is displayed, and whenY hours elapse, a 360-degree surrounding image for a scene after the Yhours is displayed. It is noted that since the human's field of view isbasically about 180 degrees, an area is cut out and displayed to fit adisplay unit of a virtual reality display apparatus 200, in a range thatcan correspond to the field of view.

The internal configuration of the image presentation module 115 will bedescribed later using an example of FIG. 3.

The output instruction reception module 120 is connected to the outputcontrol module 125. The output instruction reception module 120 receivesan output instruction from the user. The output instruction is given by,for example, a button provided in the information processing apparatus100, an operation of a controller (e.g., a remote control device)connected to the information processing apparatus 100 (e.g., anoperation by raising the controller upward and rightward), aninstruction by voice, an operation by a movement of the gaze (e.g., anoperation by gazing at an output instruction button presented in thefield of view of the user, or eye blinking), or a movement of the headpart (e.g., a gesture such as a head shaking from side to side ornodding). These operations are analyzed (e.g., voice recognition, gazeanalysis, or gesture analysis) and received as the output instruction.

The output control module 125 is connected to the image storage module110A, the user image storage module 110B, the image presentation module115, the output instruction reception module 120, and the output imageoutputting module 130. When the device that changes an image presentedin the field of view of the user along with the motion direction of theuser receives the output instruction, the output control module 125performs a control to output an area of an image being presented to theuser at the time when the output instruction is received. The outputdestination is an output device such as a two-dimensional printer 135, athree-dimensional printer 140, or an electronic image file generationmodule 145. The output destination may be selected in such a manner thata selection screen is presented to the user and the user selects theoutput destination or may be selected according to a predeterminedpriority. When the selection scree or the priority is determined, theselection screen or priority may be determined according to an objectpresent in an image being currently displayed. That is, when an objecthaving simple two-dimensional information is displayed, the priority isgiven to the two-dimensional printer 135 or the electronic image filegeneration module 145. Meanwhile, when an object havingthree-dimensional information is displayed, the priority is given to thethree-dimensional printer 140. The three-dimensional information is, forexample, information defined by stereolithography standard triangulatedlanguage (STL), voxel, or fabricatable voxel (FAV).

In addition, the output control module 125 may perform a control tooutput the image to the electronic image file generation module 145 thatgenerates an electronic image file of the image. In addition, theelectronic image file generation module 145 may be provided in theinformation processing apparatus 100 or may be an apparatus outside theinformation processing apparatus 100.

In addition, the output control module 125 may perform a control tooutput the image to the three-dimensional printer 140 that generates athree-dimensional object from the image. When the area being presentedin the field of view of the user includes three-dimensional data, theoutput control module 125 may perform a control to output at least thethree-dimensional data to the three-dimensional printer 140.

In addition, the output control module 125 may perform a control tooutput the image to the two-dimensional printer 135 that prints theimage on a two-dimensional recording medium. The two-dimensionalrecording medium is, for example, paper, label, fabric or resin.

In addition, when the output instruction is received, the output controlmodule 125 may perform a control so that a form of the image to beoutput on the two-dimensional recording medium is caused to be aborderless form.

In addition, when the output instruction is received, the output controlmodule 125 may perform a control to determine the form of the image tobe output on the two-dimensional recording medium, according to whetherthe output destination is capable of performing a borderless printing.

For example, when the output instruction is received and when the outputdestination is capable of performing the borderless printing, the outputcontrol module 125 may perform a control so that the form of the imageto be output on the two-dimensional recording medium is caused to be theborderless form.

In addition, when the output instruction is received and when the outputdestination is incapable of performing the borderless printing, theoutput control module 125 may perform a control so that the form of theimage to be output on the two-dimensional recording medium is caused tobe a bordered form.

In addition, when the device that changes an image presented in thefield of view of the user along with the motion direction of the userreceives the output instruction, the output control module 125 performsa control to output an image including a first image of an area that isbeing presented to the field of view of the user at the time when theoutput instruction is received, and a second image outside the area.

The “image including the first image and the second image” may be eitheran image obtained by combining the first image and the second image tobe superposed on each other, or an image obtained by combining the firstimage and the second image to be connected to each other.

In addition, the output control module 125 may perform the control tooutput the image including the first image and the second image to theelectronic image file generation module 145 that generates an electronicimage file of the image including the first image and the second image.

In addition, the output control module 125 may perform the control tooutput the image including the first image and the second image to thethree-dimensional printer 140 that generates a three-dimensional objectfrom the image including the first image and the second image. Inaddition, when three-dimensional data is included in the area that isbeing presented to the user, at least the three-dimensional data may beoutput to the output destination. When three-dimensional data isincluded in the area of the second image as well, the control may beperformed so that the three-dimensional printer 140 outputs thethree-dimensional data.

In addition, the output control module 125 may perform the control tooutput the image including the first image and the second image to thetwo-dimensional printer 135 that prints the image including the firstimage and the second image on a two-dimensional recording medium. Then,when the output instruction is received, the form of the image to beoutput on the two-dimensional recording medium may be caused to be aborderless form.

In addition, when the output instruction is received, the output controlmodule 125 may set a form of the image to be output on thetwo-dimensional recording medium to be a borderless form.

In addition, when the output instruction is received, the output controlmodule 125 may determine the form of the image to be output on thetwo-dimensional recording medium, according to whether the outputdestination is capable of performing a borderless printing.

For example, when the output instruction is received and when the outputdestination is capable of performing the borderless printing, the outputcontrol module 125 may set the form of the image to be output on thetwo-dimensional recording medium to be the borderless form.

For example, when the output instruction is received and when the outputdestination is incapable of performing the borderless printing, theoutput control module 125 may set the form of the image to be output onthe two-dimensional recording medium to be the bordered form.

In addition, the second image is an image that is presentable but is notincluded in the field of view of the user at the time when the outputinstruction is received. For example, the second image is an image thatthe user may be able to see by turning his/her head but is not seeing(an image that the user cannot see or an image outside the field ofview). Specifically, the second image corresponds to an image behind theuser at the time when the output instruction is received.

In addition, the second image is an image located at a position on anyone or more of the left side, the right side, the upper side, and thelower side of the first image. A positional relationship between thefirst image and the second image is illustrated.

In addition, when outputting the image including the first image and thesecond image, the output control module 125 may perform the output sothat the first image and the second image are distinguished from eachother. For example, a figure indicating a boundary between the firstimage and the second image may be added and output. The figureindicating the boundary may be, for example, a line (e.g., a white lineor a red line). In addition, the first image may be output as it is, andthe second image may be output lightly.

In addition, the output control module 125 may determine in whichdirection of the first image the second image is arranged. As for “inwhich direction of the first image the second image is arranged,” thefirst image and the second image form a panoramic image. It isdetermined, for example, (1) whether to arrange the second image whilecentering the first image, (2) whether to output the second imageclockwise with respect to the first image (arrange the second image onthe right side of the first image), or (3) whether to output the secondimage counterclockwise with respect to the first image (arrange thesecond image on the left side of the first image).

In addition, the arrangement may be determined according to aninstruction from the user or according to a predetermined arrangement.

In addition, the output control module 125 may determine a position ofthe first image and arrange the second image around the position.

In addition, when an image non-display area exists at an edge of adisplay area of the image being presented by the device (as a specificexample, the head mounted display) and when the output instruction isreceived, the output control module 125 may preferentially output abordered image.

In addition, where the image non-display area does not exist at the edgeof the display area of the image being presented by the device and whenthe output instruction is received, the output control module 125 maypreferentially output a borderless image.

The output control module 125 may generate the second image using thedata in the image storage module 110A.

In addition, the output control module 125 may assume that a motion B isperformed in addition to a motion A of the user at the time when theoutput instruction is received and may cause the image presentationmodule 115 to generate an image to be presented. The motion B is amotion to cause an image, other than the image presented by the motionA, to be presented. Specifically, the motion B is a motion for seeing anarea that cannot be seen by the motion A, and corresponds to, forexample, a motion of turning the head.

Because there is a possibility of a different development if the user isseeing an area that the user does not see, the image presentation module115 is caused to generate an image on the assumption that the userperforms such a motion. For example, when the user is looking at theback in a game, a different story is developed. To this end, the outputcontrol module 125 transfers the result equivalent to the detectionresult by the movement detection module 105 to the image presentationmodule 115, and causes the image presentation module 115 to generate animage on the assumption that the motion is performed at the date andtime when the output instruction is received.

In addition, when a borderless image exists in only one of the firstimage of the area being presented to the field of view of the user andthe second image outside the area, the output control module 125 mayinquire the user about a setting of the output.

In addition, when a uniform image exists in the second image which is anarea outside the field of view of the user, the output control module125 notifies the user of a warning of the output.

In addition, when an image instructed by the user's operation to beoutput includes an image which is inadequate, the output control module125 performs the output excluding an image inadequate to the output.

In addition, when the device that changes an image presented in thefield of view of the user along with the motion direction of the userreceives the output instruction, the output control module 125 performsa control to output an image including a presentation image that isbeing presented to the field of view of the user at the time when theoutput instruction is received, and a user's own image (an image of auser who is using the information processing apparatus 100).

In addition, the output control module 125 may output the imageincluding the presentation image and the user image to the electronicimage file generation module 145 that generates an electronic image fileof the image including the presentation image and the user's own image.

In addition, the output control module 125 may output the imageincluding the presentation image and the user image to thethree-dimensional printer 140 that generates a three-dimensional objectfrom the image including the presentation image and the user image. Whenthe area being presented to the user includes three-dimensional data,the output control module 125 may perform a control to output at leastthe three-dimensional data to the three-dimensional printer 140.

In addition, the output control module 125 may output the imageincluding the presentation image and the user image to thetwo-dimensional printer 135 that prints the image including thepresentation image and the user image on a two-dimensional recordingmedium.

Then, in that case (where the image including the presentation image andthe user image is output), when receiving the output instruction, theoutput control module 125 may perform a control to cause a form of theimage to be output on the two-dimensional recording medium to be aborderless form.

In addition, when the output instruction is received, the output controlmodule 125 may perform a control to determine the form of the image tobe output on the two-dimensional recording medium, according to whetherthe output destination is capable of performing a borderless printing.

For example, when the output instruction is received and when the outputdestination is capable of performing the borderless printing, the outputcontrol module 125 may perform a control so that the form of the imageto be output on the two-dimensional recording medium is caused to be theborderless form.

In addition, when the output instruction is received and when the outputdestination is incapable of performing the borderless printing, theoutput control module 125 may perform a control so that the form of theimage to be output on the two-dimensional recording medium is caused tobe a bordered form.

In addition, the output control module 125 may perform a control tooutput an image including the presentation image, the user image, and auser image of another user.

For example, when there is another user B who is using the same contentsas the contents (application) being processed in the informationprocessing apparatus 100, the output control module 125 may perform acontrol to output an image including the presentation image, the userimage, and a user image of the other user B. For example, when there isa user B who is enjoying the same game in another information processingapparatus 100 (more specifically, when two users are competing orcooperating with each other in a game), the user image of the user whois using the information processing apparatus 100 and the image of theuser B who is using the other information processing apparatus 100 arecombined with the presentation image and output.

For example, when the output control module 125 receives the outputinstruction and when another user C is present near the user who isusing the information processing apparatus 100, the output controlmodule 125 may perform a control to output an image including thepresentation image, the user image, and a user image of the other userC. For example, when there is the user C who is using anotherinformation processing apparatus 100 at a (physically) nearby place inthe real world (regardless of whether the user C is using the samecontents), the user images of the user who is using the informationprocessing apparatus 100 and the user C who is using the otherinformation processing apparatus 100 are combined with the presentationimage and output.

In addition, when the user moves to a predetermined position in thecontents being processed in the information processing apparatus 100,the output control module 125 may urge the user to make the outputinstruction or may determine that the output instruction is received andperform the control of the output. For example, when the user moves to asymbolic spot where it can be recognized that the user is using thecontents (more specifically, an instagram worthy scene), a messageurging the user to take a photograph may be presented, or a photographmay be automatically taken.

In addition, when receiving the output instruction, the output controlmodule 125 may receive a setting change of the user's own image. Forexample, the setting change may be related to an arrangement position orangle of the user image. Alternatively, the setting change may berelated to the facial expression of the user in the user image.

In addition, when performing the output, the output control module 125may generate information for managing history information of the userand the image to be output. In addition, the generated information maybe embedded in the image to be output. This information may be used ashistory information for the user (e.g., indicating when the contents areused or what contents are used), or may have a function asidentification information. “Embedding the information in the image” maybe implemented using an information hiding (data hiding) technique suchas electronic watermarking. The information hiding technique may beeither a perceptible type in which a human being also can perceive theembedded information, or an imperceptible type in which it is hard for ahuman being to perceive the embedded information. The historyinformation may be managed in the information processing apparatus 100or in an external device such as a server that manages the VR contents.

The output image outputting module 130 is connected to the outputcontrol module 125, the two-dimensional printer 135, thethree-dimensional printer 140, and the electronic image file generationmodule 145. The output image outputting module 130 outputs an image tothe two-dimensional printer 135, the three-dimensional printer 140 orthe electronic image file generation module 145, according to thecontrol of the output control module 125. The communication between theoutput image outputting module 130 and the two-dimensional printer 135,the three-dimensional printer 140 or the electronic image filegeneration module 145 may be either a wired or wireless communication.

The two-dimensional printer 135 is connected to the output imageoutputting module 130 of the information processing apparatus 100. Thetwo-dimensional printer 135 prints an image transferred from the outputimage outputting module 130 on the two-dimensional recording medium. Thetwo-dimensional printer 135 is, for example, a general printer. Forexample, the two-dimensional printer 135 may use any of anelectrophotographic method and an inkjet method.

The three-dimensional printer 140 is connected to the output imageoutputting module 130 of the information processing apparatus 100. Thethree-dimensional printer 140 generates a three-dimensional objectaccording to the image (including the three-dimensional data)transferred from the output image outputting module 130. That is, thethree-dimensional printer 140 is a device that shapes athree-dimensional object (product) based on the three-dimensional data.The three-dimensional printer 140 may also be called a 3D printer. Asfor the shaping method, for example, any of the stereolithography, apowder method, fused deposition modeling, sheet lamination, and aninkjet method may be used.

The electronic image file generation module 145 is connected to theoutput image outputting module 130 of the information processingapparatus 100. The electronic image file generation module 145 generatesan electronic image file of the image transferred from the output imageoutputting module 130. For example, the electronic image file generationmodule 145 converts the image into a PDF (portable document format)file. It is noted that the electronic image file generation module 145may be provided in the information processing apparatus 100.

FIG. 2 is an explanatory view illustrating an example of the systemconfiguration using the present exemplary embodiment.

The virtual reality display apparatus 200 is called a head mounteddisplay. The virtual reality display apparatus 200 includes theinformation processing apparatus 100. The virtual reality displayapparatus 200 has, for example, a goggle shape. Alternatively, thevirtual reality display apparatus 200 may have a shape of eye glasses.The image presentation module 115 of the information processingapparatus 100 includes a presentation unit (e.g., a display or screen)configured to cover the vision (field of view or a field in front ofeyes) of a user 290 wearing the virtual reality display apparatus 200.That is, the virtual reality display apparatus 200 is configured so thatwhen the virtual reality display apparatus 200 is mounted on the head ofthe user 290, the presentation unit of the image presentation module 115is disposed in front of the left and right eyes of the user 290. As aresult, the user 290 views only an image presented by the imagepresentation module 115 in the field of view, and can be immersed in thevirtual space. The image presentation module 115 may be configured witha left-eye presentation unit to be projected to the left eye of the user290 and a right-eye presentation unit to be projected to the right eyeof the user 290.

The movement detection module 105 of the information processingapparatus 100 includes at least one of a geomagnetic sensor, anacceleration sensor, an inclination sensor (e.g., an angular velocitysensor or a gyroscope sensor) or a gaze sensor. The movement detectionmodule 105 of the information processing apparatus 100 is capable ofdetecting various movements of the virtual reality display apparatus 200mounted on the head of the user 290 (that is, various movements of thehead of the user) or the gaze of the user 290.

In addition, the virtual reality display apparatus 200 may include, forexample, a controller operated by the user 290, a microphone receivingthe voice of the user 290, a speaker (including headphones andearphones) outputting the voice, and a motion sensor that detects amovement of the body (e.g., the hands, fingers, legs, and the like) ofthe user 290.

For example, after the virtual reality display apparatus 200 isactivated, a reference position of the user 290 is determined. Byestimating an amount of a displacement (angular change such as gyro)from the reference position, it is determined which image in the360-degree surroundings in the scene is to be displayed based on thereference position. Thus, when the output instruction is made at thecurrently displayed position of the user 290 which is determined foreach scene, a displayed image or the displayed image and an image thatcan be displayed but is not displayed at the time point are output toany one of the two-dimensional printer 135, the three-dimensionalprinter 140, and the electronic image file generation module 145, or acombination thereof. An output destination is determined, for example,through a selection screen, based on a device (the two-dimensionalprinter 135, the three-dimensional printer 140, or the electronic imagefile generation module 145) connected at that time, or based on thepriorities which are defined by the user 290 in advance.

When the output instruction is made, a preview screen of the image to beoutput may be displayed, a screen for various settings such as a sizemay be displayed as in an output instruction from a general personalcomputer, and the output may be determined after the instruction iscompleted on the screen. For example, on the preview screen, thearrangement position and angle of the user image, and the facialexpression of the user 290 may be changeable.

In addition, the electronic image file generation module 145 may postthe generated image file on, for example, SNS (social networkingservice). Especially, when the image including the user's own image isoutput, the image may be posted as a photograph that the user takes ofthe user herself.

The contents of the VR are, for example, games, travel, real estatepreview, and school classes.

FIG. 3 is a conceptual module configuration diagram illustrating anexample of the configuration of the image presentation module 115.

The image presentation module 115 includes presentation and detectionmodules 310 a and 310 b and an image generation module 330. It is notedthat the presentation and detection modules 310 a and 310 b,presentation modules 315 a and 315 b, and eyeball detection modules 320a and 320 b have the same configurations for both of the left and righteyes. Thus, these components will be denoted with the reference numerals310, 315, and 320 in the following descriptions.

The image storage module 110A is connected to the image generationmodule 330 of the image presentation module 115. The image generationmodule 330 is connected to the image storage module 110A and thepresentation and detection module 310. The presentation and detectionmodule 310 includes the presentation module 315 and the eyeballdetection module 320, and is connected to the image generation module330.

Based on image data acquired from the image storage module 110A, theimage generation module 330 generates image signals to be output to theleft and right presentation modules 315 (the presentation modules 315 aand 315 b). Next, the presentation module 315 emits image lightcorresponding to the image signals to respective display surfaces, sothat the image is presented to the eyes 390 of the user 290.

The eyeball detection module 320 detects the gaze of the eyes 390 of theuser 290. The eyeball detection module 320 performs a part of theprocess by the movement detection module 105.

FIG. 4 is a flowchart illustrating an example of a process according tothe present exemplary embodiment.

In step S402, the output instruction reception module 120 determineswhether the output instruction is received from the user 290. When it isdetermined that the output instruction is received, the process proceedsto step S404. Otherwise, the process stands by until the outputinstruction is received.

In step S404, it is determined whether the output instruction targetsonly the image in the field of view. When it is determined that theoutput instruction targets only the image in the field of view, theprocess proceeds to step S406. Otherwise, the process proceeds to stepS408. For example, the determination may be made according to theinstruction from the user 290 (an instruction to output only the imagein the field of view or an instruction to output the image outside thefield of view as well). In addition, the target may be determined bydefault.

In step S406, the image in the field of view is output. The detailedprocess of step S406 will be described later using flowchartsillustrated in examples of FIGS. 8 to 10B.

In step S408, the images in and outside the field of view are output.The detailed process of step S408 will be described later using theflowcharts illustrated in the examples of FIGS. 8 to 10B.

FIG. 5 is a flowchart illustrating an example of a process according tothe present exemplary embodiment. This process example changes a userinterface, depending on whether the image data to be output includesthree-dimensional information.

In step S502, the body or gaze of the user 290 is detected.

In step S504, an image of an area being presented to the user 290 isextracted. Specifically, an image being presented by the imagepresentation module 115 at a time point when the output instruction isreceived in step S502 may be extracted. The extracted image is the imageto be output. The image being presented includes an image for the righteye and an image for the left eye, and any one of the images for theright and left eyes may be extracted. In addition, an image viewed byboth eyes (the image to be output) may be generated from the images forthe right and left eyes.

In step S506, the use's own image is combined with the output image. Thedetailed process of step S506 will be described later using theflowcharts illustrated in the examples of FIGS. 12, 19, and 21. Any oneor more of processes in the flowcharts illustrated in the examples ofFIGS. 12, 19, and 21 may be performed.

In step S508, it is determined whether the image includes thethree-dimensional information. When it is determined that the imageincludes the three-dimensional information, the process proceeds to stepS510. Otherwise, the process proceeds to step S512. Thethree-dimensional information is, for example, the FAV which is a dataformat for three-dimensional printing.

In addition, the three-dimensional information may be embedded in theimage. In this case, the image presented to the user 290 is acombination of a two-dimensional image and a three-dimensional image.

In addition, for example, a link to predetermined three-dimensionalinformation to be output to the three-dimensional printer 140 may beembedded in the image. In this case, the image presented to the user 290is a two-dimensional image similar to other images. However, when theoutput instruction is made, a link associated with an object in theimage may be traced, so that the three-dimensional information to beshaped by the three-dimensional printer 140 is extracted. For example,the three-dimensional information may be extracted using thethree-dimensional object data file 2700 to be described later using theexample of FIG. 27.

In step S510, the user 290 is caused to select (1) the electronic file,(2) the two-dimensional printer 135, or (3) the three-dimensionalprinter 140, as the output destination. For example, the screen 1130illustrated in FIG. 11C is presented.

In step S512, the user 290 is caused to select (1) the electronic fileor (2) the two-dimensional printer 135, as an output destination. Forexample, the screen 1110 illustrated in FIG. 11A is presented.

In step S514, the output destination is determined. When thethree-dimensional printer 140 is selected, the process proceeds to stepS516. When the two-dimensional printer 135 is selected, the processproceeds to step S520. When the electronic file is selected, the processproceeds to step S524.

In step S516, the image data including the three-dimensional informationis output to the three-dimensional printer 140.

In step S518, the three-dimensional printer 140 generates athree-dimensional object.

In step S520, the image data is output to the two-dimensional printer135. The detailed process of step S520 will be described later using theflowchart illustrated in the example of FIG. 24 or 25.

In step S522, the two-dimensional printer 135 performs printing.

In step S524, the image data is output to the electronic image filegeneration module 145.

In step S526, the electronic image file generation module 145 generatesan electronic file.

FIG. 6 is a flowchart illustrating an example of a process according tothe present exemplary embodiment. This process example relates to a userinterface that preferentially selects the three-dimensional printer 140when the image data to be output includes the three-dimensionalinformation. The processes of steps S602 to S608 are the same as theprocesses of steps S502 to S508 of the flowcharts illustrated in theexample of FIG. 5, and the processes of steps S616 to S628 are the sameas the processes of steps S514 to S526 of the flowchart illustrated inthe example of FIG. 5.

In step S602, the body or gaze of the user 290 is detected.

In step S604, an image of an area being presented to the user 290 isextracted.

In step S606, the user's own image (the image of the user 290 herself)is combined with the output image. The detailed process of step S606will be described later using flowcharts illustrated in the examples ofFIGS. 12, 19 and 21. Any one or more of processes in the flowchartsillustrated in the examples of FIGS. 12, 19, and 21 may be performed.

In step S608, it is determined whether the image includes thethree-dimensional information. When it is determined that the imageincludes the three-dimensional information, the process proceeds to stepS610. Otherwise, the process proceeds to step S614.

In step S610, it is confirmed with the user 290 whether to output to thethree-dimensional printer 140. For example, the screen 1120 illustratedin FIG. 11B is presented.

In step S612, it is determined whether to output to thethree-dimensional printer 140. When it is determined to output, theprocess proceeds to step S616. Otherwise, the process proceeds to stepS614.

In step S614, the user 290 is caused to select (1) the electronic fileor (2) the two-dimensional printer 135, as an output destination. Forexample, the screen 1110 illustrated in FIG. 11A is presented.

In step S616, the output destination is determined. When thethree-dimensional printer 140 is selected, the process proceeds to stepS618. When the two-dimensional printer 135 is selected, the processproceeds to step S622. When the electronic file is selected, the processproceeds to step S626.

In step S618, the image data including the three-dimensional informationis output to the three-dimensional printer 140.

In step S620, the three-dimensional printer 140 generates athree-dimensional object.

In step S622, the image data is output to the two-dimensional printer135. The detailed process of step S622 will be described later using theflowchart illustrated in the example of FIG. 24 or 25.

In step S624, the two-dimensional printer 135 performs printing.

In step S626, the image data is output to the electronic image filegeneration module 145.

In step S628, the electronic image file generation module 145 generatesan electronic file.

FIG. 7 is a flowchart illustrating an example of a process according tothe present exemplary embodiment. In this process example, for example,a process deals with a case where the three-dimensional printer 140 isselected as the output destination regardless of whether the image datato be output includes the three-dimensional information. The processesof steps S702 to S706 and S712 are the same as the processes of stepsS502 to S508 of the flowcharts illustrated in the example of FIG. 5, andthe processes of steps S716 to S728 are the same as the processes ofsteps S514 to S526 of the flowchart illustrated in the example of FIG.5.

In step S702, the body or gaze of the user 290 is detected.

In step S704, an image of an area being presented to the user 290 isextracted.

In step S706, the user's own image (the image of the user 290 herself)is combined with the output image. The detailed process of step S706will be described later using flowcharts illustrated in the examples ofFIGS. 12, 19 and 21. Any one or more of processes in the flowchartsillustrated in the examples of FIGS. 12, 19, and 21 may be performed.

In step S708, the user 290 is caused to select (1) the electronic file,(2) the two-dimensional printer 135, or (3) the three-dimensionalprinter 140, as the output destination. For example, the screen 1130illustrated in FIG. 11C is presented.

In step S710, it is determined whether the three-dimensional printer 140is selected. When it is determined that the three-dimensional printer140 is selected, the process proceeds to step S712. Otherwise, theprocess proceeds to step S716.

In step S712, it is determined whether the image to be output includesthe three-dimensional information. When it is determined that the imageincludes the three-dimensional information, the process proceeds to stepS716. Otherwise, the process proceeds to step S714.

In step S714, the three-dimensional information is generated from theimage. The three-dimensional information may be generated from thetwo-dimensional image by using an existing technology. For example, thethree-dimensional information may be generated by using an artificialintelligence model which completes learning with pairs oftwo-dimensional images and three-dimensional images. Alternatively, thethree-dimensional information may be generated from the images for theleft and right eyes.

In step S716, the output destination is determined. When thethree-dimensional printer 140 is selected, the process proceeds to stepS718. When the two-dimensional printer 135 is selected, the processproceeds to step S722. When the electronic file is selected, the processproceeds to step S726.

In step S718, the image data including the three-dimensional informationis output to the three-dimensional printer 140.

In step S720, the three-dimensional printer 140 generates athree-dimensional object.

In step S722, the image data is output to the two-dimensional printer135. The detailed process of step S722 will be described later using theflowchart illustrated in the example of FIG. 24 or 25.

In step S724, the two-dimensional printer 135 performs printing.

In step S726, the image data is output to the electronic image filegeneration module 145.

In step S728, the electronic image file generation module 145 generatesan electronic file.

FIG. 8 is a flowchart illustrating an example of a process according tothe present exemplary embodiment. FIG. 8 corresponds to the flowchartillustrated in the example of FIG. 5 and illustrates the process appliedto a case where the first image and the second image are output.

In step S802, the body or gaze of the user 290 is detected.

In step S804, an image of an area being presented to the user 290 isextracted.

In step S806, the image that is presentable to the user 290 but is notpresented at that time is extracted.

In step S808, the user's own image (the image of the user 290 herself)is combined with the output image. The detailed process of step S808will be described later using flowcharts illustrated in the examples ofFIGS. 12, 19 and 21. Any one or more of processes in the flowchartsillustrated in the examples of FIGS. 12, 19, and 21 may be performed.

In step S810, it is determined whether three-dimensional information isincluded in the image (any of (i) only the image extracted in step S804(corresponding to the first image), (ii) only the image extracted instep S806 (corresponding to the second image), (iii) the image extractedin step S804 or S806, and (iv) the images extracted in steps S804 andS806). When the three-dimensional information is included in the image,the process proceeds to step S812. Otherwise, the process proceeds tostep S814. The three-dimensional information is, for example, the FAVwhich is a data format for three-dimensional printing.

In addition, the three-dimensional information may be embedded in theimage. In this case, the image presented to the user 290 is acombination of a two-dimensional image and a three-dimensional image.

In addition, for example, a link to predetermined three-dimensionalinformation to be output to the three-dimensional printer 140 may beembedded in the image. In this case, the image presented to the user 290is a two-dimensional image similar to other images. However, when theoutput instruction is made, a link associated with an object in theimage may be traced, so that the three-dimensional information to beshaped by the three-dimensional printer 140 is extracted. For example,the three-dimensional information may be extracted using thethree-dimensional object data file 2700 to be described later using theexample of FIG. 27.

In step S812, the user 290 is caused to select (1) the electronic file,(2) the two-dimensional printer 135, or (3) the three-dimensionalprinter 140, as the output destination. For example, the screen 1130illustrated in FIG. 11C is presented.

In step S814, the user is caused to select (1) the electronic file or(2) the two-dimensional printer 135, as an output destination. Forexample, the screen 1110 illustrated in FIG. 11A is presented.

In step S816, the output destination is determined. When thethree-dimensional printer 140 is selected, the process proceeds to stepS818. When the two-dimensional printer 135 is selected, the processproceeds to step S822. When the electronic file is selected, the processproceeds to step S826.

In step S818, the image data including the three-dimensional informationis output to the three-dimensional printer 140.

In step S820, the three-dimensional printer 140 generates athree-dimensional object.

In step S822, the image data is output to the two-dimensional printer135. The detailed process of step S822 will be described later using theflowchart illustrated in the example of FIG. 24 or 25.

In step S824, the two-dimensional printer 135 performs printing.

In step S826, the image data is output to the electronic image filegeneration module 145.

In step S828, the electronic image file generation module 145 generatesan electronic file.

FIGS. 9A and 9B are flowcharts illustrating an example of a processaccording to the present exemplary embodiment. FIGS. 9A and 9Bcorresponds to the flowchart illustrated in the example of FIG. 6 andillustrates the process applied to a case where the first image and thesecond image are output. The processes of steps S902 to S910 are thesame as the processes of steps S802 to S810 of the flowchartsillustrated in the example of FIG. 8, and the processes of steps S918 toS930 are the same as the processes of steps S816 to S828 of theflowchart illustrated in the example of FIG. 8.

In step S902, the body or gaze of the user 290 is detected.

In step S904, an image of an area being presented to the user 290 isextracted.

In step S906, the image that is presentable to the user 290 but is notpresented at that time is extracted.

In step S908, the user's own image (the image of the user 290 herself)is combined with the output image. The detailed process of step S908will be described later using flowcharts illustrated in the examples ofFIGS. 12, 19 and 21. Any one or more of processes in the flowchartsillustrated in the examples of FIGS. 12, 19, and 21 may be performed.

In step S910, it is determined whether the image includes thethree-dimensional information. When it is determined that the imageincludes the three-dimensional information, the process proceeds to stepS912. Otherwise, the process proceeds to step S916.

In step S912, it is confirmed with the user 290 whether to output to thethree-dimensional printer 140. For example, the screen 1120 illustratedin FIG. 11B is presented.

In step S914, it is determined whether to output to thethree-dimensional printer 140. When it is determined to output, theprocess proceeds to step S918. Otherwise, the process proceeds to stepS916.

In step S916, the user 290 is caused to select (1) the electronic fileor (2) the two-dimensional printer 135, as an output destination. Forexample, the screen 1110 illustrated in FIG. 11A is presented.

In step S918, the output destination is determined. When thethree-dimensional printer 140 is selected, the process proceeds to stepS920. When the two-dimensional printer 135 is selected, the processproceeds to step S924. When the electronic file is selected, the processproceeds to step S928.

In step S920, the image data including the three-dimensional informationis output to the three-dimensional printer 140.

In step S922, the three-dimensional printer 140 generates athree-dimensional object.

In step S924, the image data is output to the two-dimensional printer135. The detailed process of step S924 will be described later using theflowchart illustrated in the example of FIG. 24 or 25.

In step S926, the two-dimensional printer 135 performs printing.

In step S928, the image data is output to the electronic image filegeneration module 145.

In step S930, the electronic image file generation module 145 generatesan electronic file.

FIGS. 10A and 10B are flowcharts illustrating an example of a processaccording to the present exemplary embodiment. FIGS. 10A and 10Bcorresponds to the flowchart illustrated in the example of FIG. 7 andillustrates the process applied to a case where the first image and thesecond image are output. The processes of steps S1002 to S1008 and S1014are the same as the processes of steps S802 to S810 of the flowchartsillustrated in the example of FIG. 8, and the processes of steps S1018to S1030 are the same as the processes of steps S816 to S828 of theflowchart illustrated in the example of FIG. 8.

In step S1002, the body or gaze of the user 290 is detected.

In step S1004, an image of an area being presented to the user 290 isextracted.

In step S1006, the image that is presentable to the user 290 but is notpresented at that time is extracted.

In step S1008, the user's own image (the image of the user 290 herself)is combined with the output image. The detailed process of step S1008will be described later using flowcharts illustrated in the examples ofFIGS. 12, 19 and 21. Any one or more of processes in the flowchartsillustrated in the examples of FIGS. 12, 19, and 21 may be performed.

In step S1010, the user 290 is caused to select (1) the electronic file,(2) the two-dimensional printer 135, or (3) the three-dimensionalprinter 140, as the output destination. For example, the screen 1130illustrated in FIG. 11C is presented.

In step S1012, it is determined whether the three-dimensional printer140 is selected. When it is determined that the three-dimensionalprinter 140 is selected, the process proceeds to step S1014. Otherwise,the process proceeds to step S1018.

In step S1014, it is determined whether the image to be output includesthe three-dimensional information. When it is determined that the imageincludes the three-dimensional information, the process proceeds to stepS1018. Otherwise, the process proceeds to step S1016.

In step S1016, the three-dimensional information is generated from theimage. The three-dimensional information may be generated from thetwo-dimensional image by using an existing technology. For example, thethree-dimensional information may be generated by using an artificialintelligence model which completes learning with pairs oftwo-dimensional images and three-dimensional images. Alternatively, thethree-dimensional information may be generated from the images for theleft and right eyes.

In step S1018, the output destination is determined. When thethree-dimensional printer 140 is selected, the process proceeds to stepS1020. When the two-dimensional printer 135 is selected, the processproceeds to step S1024. When the electronic file is selected, theprocess proceeds to step S1028.

In step S1020, the image data including the three-dimensionalinformation is output to the three-dimensional printer 140.

In step S1022, the three-dimensional printer 140 generates athree-dimensional object.

In step S1024, the image data is output to the two-dimensional printer135. The detailed process of step S1024 will be described later usingthe flowchart illustrated in the example of FIG. 24 or 25.

In step S1026, the two-dimensional printer 135 performs printing.

In step S1028, the image data is output to the electronic image filegeneration module 145.

In step S1030, the electronic image file generation module 145 generatesan electronic file.

FIGS. 11A to 11C are the explanatory views illustrating the examples ofthe presentation of the screen according to the exemplary embodiment.

The example in FIG. 11A illustrates the example of the presentation insteps S512, S614, S814, and S916.

For example, the screen 1110 is displayed as follows.

The screen 1130 may allow the user to designate plural outputdestinations. That is, products (two or more of a printed matter, athree-dimensional object, and an electronic file) may be obtained fromtwo or more output destinations.

FIG. 12 is a flowchart illustrating an example of a process according tothe present exemplary embodiment.

In step S1202, the user's won image (the image of the user 290 herself)is selected according to an operation of the user 290. Specifically, theuser image stored in the user image storage module 110B is selected.

In step S1204, a combination position of the user image is set. In thecase of FIG. 5, a position is set for the image extracted in step S504.In the case of FIG. 6, a position is set for the image extracted in stepS604. In the case of FIG. 8, a position is set for the image extractedin step S804 or S806. In the case of FIGS. 9A and 9B, a position is setfor the image extracted in step S904 or S906. In the case of FIGS. 10Aand 10B, a position is set for the image extracted in step S1004 orS1006.

In addition, the combination position may be set by a designationoperation by the user 290 or may be set to a predetermined position.

In step S1206, the user's own image (the image of the user 290 herself)is combined at the set position. In addition, at the time of thecombination, an adjustment with respect to the surroundings may beperformed using a related-art technique. For example, an adjustment ofcolor tone, an addition of, for example, shadow, and an adjustment of anillumination state of light may be performed.

FIG. 13 is an explanatory view illustrating an example of a processaccording to the present exemplary embodiment.

The left portion of FIG. 13 illustrates that a user 1310 is seeing a VRimage with the virtual reality display apparatus 200. The right portionof FIG. 13 illustrates an image 1300 which is an image that the user1310 is seeing or an image that the user 1310 can see with the virtualreality display apparatus 200. For example, in the VR image, an imagespace with 360-degree images (which is not limited to 360 degree, asdescribed above) is developed at a specific time t. Thus, the “imagethat the user 1310 can see” may refer to an image that the user 1310 isnot seeing but can see by taking a motion of, for example, looking back,at the time t. For example, the “image that the user 1310 can see”corresponds to a background image at that time.

Taking a photograph of the user by the user herself in the image spaceof the VR image refers to adding the user's own image to a displayposition A at the time t at which the output instruction is made, so asto output and save the image. That is, a user image 1350 is added to theuser 1310.

FIG. 14 is an explanatory view illustrating an example of the datastructure of the user image table 1400. The user image table 1400 isstored in the user image storage module 110B. The user image table 1400is data for managing the user image. The user image table 1400 includesa user image ID field 1405, a capturing date/time field 1410, a typefield 1415, a capturing angle field 1420, a camera-to-user distancefield 1425, a two-dimensional image/three-dimensional image field 1430,and a user image field 1435. In the present exemplary embodiment, theuser image ID field 1405 stores information for uniquely identifying theuser image (user image ID: Identification). The capturing date/timefield 1410 stores capturing date and time. The type field 1415 stores atype. The capturing angle field 1420 stores a capturing angle. Thecamera-to-user distance field 1425 stores a distance between the cameraand the user. The two-dimensional image/three-dimensional image field1430 stores information indicating either a two-dimensional image or athree-dimensional image. The user image field 1435 stores the userimage. A two-dimensional image is an image captured by a general digitalcamera. A three-dimensional image is an image captured using, forexample, a camera, an infrared camera, an ambient light sensor, or a dotprojector which is used for the face authentication, and is data basedon which a three-dimensional object can be generated.

For example, for the user image ID: u0001, the capturing date and timeis “2017/12/24/9:00,” the type is “smiling face,” the capturing angle is“captured from obliquely upper right side,” the camera-to-user distanceis “1 m,” and the image is a two-dimensional image.

In the user image field 1435, images of various faces (e.g., smilingface, crying face, and ordinary facial expressions) and body types andposes (e.g., peace sign and jump) are stocked. The types are representedin the type field 1415.

Instead of stocking the images in advance, a user who has the virtualreality display apparatus 200 (the VR goggles) may be captured from theoutside at the capturing time, and only the face part (the part hiddenby the VR goggles) may be replaced.

In addition, the depth of field of the user 1310 which is a subject maybe made large and reflected on an electronic image in a more realisticmanner (conforming to the three-dimensional feature).

In addition, the depth of field may be reflected by a work of impartingtextures to a 3D modeling. For example, two-dimensional textures may becombined on a three-dimensional model by UV mapping.

Even though the user image 1350 (a photograph of a character that thecharacter takes of the character itself or a photograph of a user thatthe user takes of the user herself) is pasted to the same position, theimage changes as the capturing angle or the distance from the cameravaries. Thus, an appropriate image is selected using the capturing anglefield 1420 and the user image field 1435.

For example, after the user image 1350 is put in the image 1300, theuser image 1350 are selected and adjusted by moving the virtual realitydisplay apparatus 200 or using, for example, voice, gaze, or a separatecontroller.

FIG. 15 is an explanatory view illustrating an example of the datastructure of a target image table 1500. The target image table 1500manages an image at the time when the output instruction is made (animage to which the user image is to be pasted; the image 1300 in theexample of FIG. 13), among the images stored in the image storage module110A. The target image table 1500 includes a target image ID field 1505,a time field 1510, a display position field 1515, and a target imagefield 1520. In the present exemplary embodiment, the target image IDfield 1505 stores information (target image ID) for uniquely identifyinga target image. The time field 1510 stores time. The display positionfield 1515 stores a display position. The target image field 1520 storesa target image.

For example, for the target image ID: g0001, the time is“2017/12/25/9:00,” and the display position is “10 degrees to 170degrees.”

FIG. 16 is an explanatory view illustrating an example of a datastructure of the combination result table 1600. The combination resulttable 1600 is generated by the process of the flowchart illustrated inthe example of FIG. 12. The combination result table 1600 indicates animage obtained by combining the target image and the user image. Thecombination result table 1600 has a target image ID field 1605, a userimage ID field 1610, and a combination position field 1615. Thecombination position field 1615 has an X field 1620, a Y field 1625, anda Z field 1630. The target image ID field 1605 stores a target image ID.The user image ID field 1610 stores a user image ID. The combinationposition field 1615 stores a combination position. The X field 1620stores an X coordinate of the combination position. The Y field 1625stores a Y coordinate of the combination position. The Z field 1630stores a Z coordinate of the combination position (which may be treatedas being unnecessary when the user image is not a three-dimensionalimage).

Instead of the user image table 1400, a user image table 1700 may beused. That is, identification information such as an ID may be embeddedin an image captured in the virtual space. As described above, forexample, the electronic watermarking may be used. In this manner, forexample, counterfeiting prevention of the captured electronic file orcollation of the captured electronic file may be implemented.Identification information in an identification information field 1740may be determined by, for example, a captured user (accountinformation), a capturing place (virtual space or real space), capturingdate and time, an application used in the virtual reality displayapparatus 200, and a hash value of the user image.

The user image table 1700 is obtained by adding the identificationinformation field 1740 to the user image table 1400. FIG. 17 is anexplanatory view illustrating an example of the data structure of a userimage table 1700. The user image table 1700 has a user image ID field1705, a capturing date/time field 1710, a type field 1715, a capturingangle field 1720, a camera-to-user distance field 1725, atwo-dimensional image/three-dimensional image field 1730, a user imagefield 1735, and the identification information field 1740. In thepresent exemplary embodiment, the user image ID field 1705 storesinformation for uniquely identifying the user image (user image ID). Thecapturing date/time field 1710 stores capturing date and time. The typefield 1715 stores a type. The capturing angle field 1720 stores acapturing angle. The camera-to-user distance field 1725 stores adistance between the camera and the user. The two-dimensionalimage/three-dimensional image field 1730 stores information indicatingeither a two-dimensional image or a three-dimensional image. The userimage field 1735 stores the user image. The identification informationfield 1740 stores identification information.

For example, for the user image ID: u0001, the capturing date and timeis “2017/12/24/9:00,” the type is “smiling face,” the capturing angle iscapturing from obliquely upper right side, the camera-to-user distanceis “1 m,” the image is a two-dimensional image, and the identificationinformation is “a.”

When the user image table 1700 is used, a combination result table 1800may be used in place of the combination result table 1600. Thecombination result table 1800 is obtained by adding an identificationinformation field 1835 to the combination result table 1600.

FIG. 18 is an explanatory view illustrating an example of the datastructure of the combination result table 1800. The combination resulttable 1800 has a target image ID field 1805, a user image ID field 1810,a combination position field 1815, and an identification informationfield 1835. The combination position field 1815 has an X field 1820, a Yfield 1825, and a Z field 1830. The target image ID field 1805 stores atarget image ID. The user image ID field 1810 stores a user image ID.The combination position field 1815 stores a combination position. The Xfield 1820 stores an X coordinate of the combination position. The Yfield 1825 stores a Y coordinate of the combination position. The Zfield 1830 stores a Z coordinate of the combination position (which maybe treated as being unnecessary when the user image is not athree-dimensional image). The identification information field 1835stores identification information.

FIG. 19 is a flowchart illustrating an example of a process by thepresent exemplary embodiment.

In step S1902, the user's own image is selected according to anoperation of the user. In step S1904, an image of another user who isusing the same contents (application) is selected. As described above,the same contents refer to, for example, a case where two users arecompeting or cooperating with each other in the same game.

In step S1906, the combination position of the user images selected insteps S1902 and S1904 is set.

In step S1908, the user's own image and the image of the other user arecombined with each other at the set position.

Steps S1902, S1906, and S1908 are equivalent to steps S1202, S1204, andS1206 of the flowchart illustrated in the example of FIG. 12,respectively.

It should be noted that in steps S1906 and S1908, the image of the otheruser is also targeted in addition to the user's own image.

FIG. 20 is an explanatory view illustrating an example of a processaccording to the present exemplary embodiment.

The left portion of FIG. 20 represents that users 2010A and 2010B areseeing the same VR image with virtual reality display apparatuses 200Aand 200B, respectively. In the right portion of FIG. 20, an image 2000represents an image that the user 2010A is seeing or an image that theuser 2010A can see with the virtual reality display apparatus 200A.

When plural persons (the users 2010A and 2010B) are using the samecontents and the plural persons are present near each other on the VRcontents (at a nearby place in the virtual space) and take a photographof the plural persons by themselves in that space, user images of theplural persons may be combined and output. That is, user images 2050Aand 2050B are pasted to the image 2000. As a result, the plural personscan further enjoy the same VR contents.

FIG. 21 is a flowchart illustrating an example of a process according tothe present exemplary embodiment.

In step S2102, the user's own image is selected according to anoperation of the user.

In step S2104, when the output instruction is made, another user isextracted from the image captured by the camera 2220 provided in thevirtual reality display apparatus 200. Here, the user image of the userwho is using the virtual reality display apparatus 200 at the samephysical position is extracted, regardless of whether the user is usingthe same contents. The user image of the user who is using the samecontents and is captured by the camera 2220 may be extracted.

In step S2106, a combination position of the user images selected insteps S2102 and S2104 is set.

In step S2108, the user's own image and the image of the other user arecombined with each other at the set position.

Steps S2102, S2106, and S2108 are equivalent to steps S1202, S1204, andS1206 of the flowchart illustrated in the example of FIG. 12,respectively.

It should be noted that in steps S2106 and S2108, the image of the otheruser is also targeted in addition to the user's own image.

FIG. 22 is an explanatory view illustrating an example of a processaccording to the present exemplary embodiment.

The left portion of FIG. 22 illustrates that a user 2210A is seeing a VRimage with the virtual reality display apparatus 200. On the rightportion of FIG. 22, an image 2200 represents an image that the user2210A is seeing or an image that the user 2210A can see with the virtualreality display apparatus 200.

Even when the user 2210A is using the VR contents alone, the user 2210Amay be able to take a photograph of herself and a person (person 2210B)near the user 2210A in the reality space, by herself in the VR. At thattime, the person 2210B who does not have the virtual reality displayapparatus 200 may be captured by the camera 2220 provided in the virtualreality display apparatus 200 that the user 2210A has, or a previouslycaptured user image may be used. That is, while the user 2210A isenjoying the VR alone, the plural persons (users 2210A and 2210B) arecaptured at the selfie time. In addition, the camera 2220 may be, forexample, a digital camera capable of taking a 360-degree image.

In the example of FIG. 4, the output instruction by the user isreceived. Alternatively, a guidance may be given to make the outputinstruction.

FIG. 23 is a flowchart illustrating an example of a process by thepresent exemplary embodiment.

In step S2302, it is determined whether the user (the user who is usingthe virtual reality display apparatus 200) is present within a capturingspot. When it is determined that the user is present at the capturingspot, the process proceeds to step S2304. Otherwise, the process standsby until the user appears at the capturing spot. The capturing spot is apredetermined position in the virtual space. For example, the capturingspot is an instagram worthy scene or a scene where a predeterminedcharacter appears. In addition, a log of a spot where the outputinstruction is made may be stored and the spot where a lot of outputinstructions are made may be recommended as a capturing spot. Inaddition, the spot where a percentage of women to the captured users ishigh (a percentage of men is low) may be recommended as a capturingspot.

In step S2304, the user is notified of the capturing spot, or thevirtual reality display apparatus 200 automatically makes the outputinstruction.

When the user moves to a specific position in the VR space, the functionof notifying the specific position as a capturing spot or the functionof automatically taking an evidence image in response to the user merelymoving to the spot is implemented. Furthermore, a function of, forexample, storing or notifying the captured image, and causing thecaptured image to be a part of another document may be added.

There are companies which perform “Instagram document-based interview”in a recruiting process by allowing the posting screen of Instagram as aportfolio. With the present exemplary embodiment, for example, an imagecaptured at a specific capturing place in the VR space may be combinedwith a document (for interview) or posted on SNS, using identificationinformation corresponding to the capturing place. The image may beevaluated for the recruiting activity or photogenic value.

FIG. 24 is the flowchart illustrating the example of the process (stepsS520, S622, S722, S822, S924, and S1024) according to the presentexemplary embodiment. This process example preferentially performsprinting a borderless image.

In step S2402, a borderless image is generated.

In step S2404, the borderless image is output to the two-dimensionalprinter 135.

FIG. 25 is the flowchart illustrating the example of the process (stepsS520, S622, S722, S822, S924, and S1024) according to the presentexemplary embodiment. An image to be generated is selected depending onwhether the two-dimensional printer 135 is capable of performing theborderless printing.

In step S2502, it is determined whether the two-dimensional printer 135is capable of performing the borderless printing. When it is determinedthat the two-dimensional printer 135 is capable of performing theborderless printing, the process proceeds to step S2504. Otherwise, theprocess proceeds to step S2508. For example, the determination processmay be performed by using a printer attribute table 2800 to be describedlater with reference to FIG. 28.

In step S2504, a borderless image is generated.

In step S2506, the borderless image is output to the two-dimensionalprinter 135.

In step S2508, a bordered image is generated.

In step S2510, the bordered image is output to the two-dimensionalprinter 135.

FIG. 26 is an explanatory view illustrating an example of the datastructure of a printing target image table 2600.

The printing target image table 2600 manages images which are output bythe output control module 125. The printing target image table 2600 hasa target image ID field 2605, a date/time field 2610, a presentationimage field 2615, and a presentable image filed 2620. The target imageID field 2605 stores a target image ID. The date/time field 2610 storesdate and time (year, month, day, hour, minute, second, second or less,or a combination thereof) when the output instruction is made. Thepresentation image field 2615 stores the image being presented by theimage presentation module 115 to the field of view of the user 290 atthe date and time (corresponding to the first image). The presentableimage filed 2620 stores an image that is presentable at the date andtime (corresponding to the second image). This image is generated by theimage presentation module 115 or the output control module 125. Inaddition, the images in the presentation image field 2615 and thepresentable image filed 2620 may be image data itself or may be linksinto the image storage module 110A.

The output image outputting module 130 outputs the images in thepresentation image field 2615 and the presentable image filed 2620.

It should be noted that the target image ID field 2605 of the printingtarget image table 2600 corresponds to the target image ID field 1605(the target image ID field 1805) of the combination result table 1600illustrated in the example of FIG. 16 (the combination result table 1800illustrated in the example of FIG. 18) and that the image of the user290 (or an image of another user 290), a presentation image, and apresentable image may be associated with each other.

FIG. 27 is an explanatory view illustrating an example of the datastructure of the three-dimensional object data file 2700.

The three-dimensional object data file 2700 is used in a case where thethree-dimensional information is extracted from the image to be output.The three-dimensional object data file 2700 has an elapsed time field2705, a position field 2710, and an object ID field 2720. The positionfield 2710 has an X field 2712, a Y field 2714, and a Z field 2716. Theelapsed time field 2705 stores elapsed time from the start of theapplication software in the virtual reality display apparatus 200. Theposition field 2710 stores a position where an object exists. The Xfield 2712 stores an X coordinate of the position. The Y field 2714stores a Y coordinate of the position. The Z field 2716 stores a Zcoordinate of the position. That is, the position of the object isindicated by the elapsed time field 2705 and the position field 2710 (atime position and a spatial position). In the present exemplaryembodiment, the object ID field 2720 stores information for uniquelyidentifying the object (object ID). The three-dimensional informationmay be extracted from the object ID. In addition, the object ID may be afile name of the three-dimensional information.

In the object ID field 2720 of the three-dimensional object data file2700, the ID of the image of the user 290 (or an image of another user290) may be stored.

FIG. 28 is an explanatory view illustrating an example of the datastructure of the printer attribute table 2800. The printer attributetable 2800 is a table for managing the performance of thetwo-dimensional printer 135 (specifically, whether the two-dimensionalprinter 135 is capable of performing the borderless printing).

The printer attribute table 2800 has a printer ID field 2805, aborderless printable/unprintable field 2810, a black-and-white/colorfield 2815, and a paper size field 2820. In the present exemplaryembodiment, the printer ID field 2805 stores information for uniquelyidentifying the printer (printer ID). The borderlessprintable/unprintable field 2810 stores information as to whether theprinter is capable of performing the borderless printing. Theblack-and-white/color field 2815 stores information as to whether theprinter is capable of only the black-and-white printing or both of theblack-and-white printing and the color printing. The paper size field2820 stores a printable paper size.

FIGS. 29A to 29C are explanatory views illustrating examples of aprocess according to the present exemplary embodiment.

The virtual reality display apparatus 200 detects a movement of the bodyor gaze of the user 290, and presents a presentation image 2910 to theuser 290. At this time point, a 360-degree surrounding image 2900 isprepared. That is, if the user 290 conducts a motion, for example, turnsto right at this time point, the image of the right side of thepresentation image 2910 is presented. Here, when the output instructionis received, the presentation image 2910 is output in accordance with adimension (two dimensions when a recording medium is a paper) and thesize of the recording medium. It should be noted that a user image 2950is combined with the presentation image 2910.

In addition, since the VR image is the 360-degree surrounding image, itmay be preferable to print the 360-degree surrounding image at a timewhen the entire scene is to be included in the two-dimensional recordingmedium even though the image being currently viewed by the user 290 is apartial area.

The image 2900 represents an example where the 360-degree surroundingimage is printed as a plan view viewed from above, on the entire sheet.The portion of the presentation image 2910 may be surrounded by, forexample, a red frame to suggest the area of the place that the user 290is viewing.

That is, here, when the output instruction is received, both thepresentation image 2910 (corresponding to the first image) and the imageother than the presentation image 2910 (corresponding to the secondimage) are output in accordance with the dimension of the recordingmedium (two dimensions when the recording medium is a paper) and thesize of the recording medium. That is, the entire image 2900 is output.

In addition, since the image to be output is basically obtained bycutting off a part of the 360-degree image 2900, the image remains in anedge area. Accordingly, in a case where the printer (printingapplication) has both of a bordered printing mode and a borderlessprinting mode, the borderless printing mode is preferentially selectedwhen a VR image is output, so as not to cause an unnatural feelingbetween the displayed object and the printed matter, to the user 290.Therefore, the borderless printing is preferentially set. It is notedthat when a restriction is applied to a display area of the image thatthe virtual reality display apparatus 200 presents to the user 290 sothat an image non-display area exists at an edge (see FIG. 29B) and whenthe output instruction is received, a process may be performed such thatthe bordered output is preferentially performed. In addition, in a casewhere the printer has a function of switching a priority between theborderless output and the bordered output based on such a situationdetermination, a process may be performed such that the borderlessoutput is preferentially performed as long as the image that the virtualreality display apparatus 200 presents to the user 290 is displayed upto the edge of the display area (see FIG. 29C). In this way, even whenan image which continues in the entire 360-degree surroundings is notprepared, an output form may be appropriately set along with a controlof a display of the virtual reality display apparatus 200. In addition,FIG. 29B illustrates an example where since a display image area 2910 bis smaller than a display area 2950 b of the virtual reality displayapparatus 200, the image non-display area exists at the edge. In thiscase, the bordered image is preferentially output. In addition, FIG. 29Cillustrates an example where since a display image area 2910 c is thesame in size as a display area 2950 c of the virtual reality displayapparatus 200, no image non-display area exists at the edge. In thiscase, the borderless image is preferentially output.

In addition, for example, when an object which is three-dimensionalinformation (e.g., a person) is included only in the presentation image2910, when an object which is three-dimensional information is includedonly in the image other than the presentation image 2910, or whenobjects which are three-dimensional information are included in both ofthe presentation image 2910 and the image other than the presentationimage 2910 in the image 2900, the screen 1130 is presented in theflowcharts illustrated in the examples of FIGS. 5 and 8, and the screen1120 is presented in the flowcharts illustrated in the examples of FIGS.6, 9A, and 9B. Meanwhile, when no three-dimensional information isincluded in the images, the screen 1110 is presented in the flowchartsillustrated in the examples of FIGS. 5, 6, 8, and 9.

FIGS. 30A to 30C are explanatory views illustrating examples of aprocess according to the present exemplary embodiment. In the examplesof FIGS. 29A to 29C, the circular image 2900 is illustrated as the360-degree surrounding image. Alternatively, for example, the 360-degreesurrounding image may be a panoramic image which is managed in arectangular shape such that the right and left ends of the imagecontinue to each other. An image 3000 is the panoramic image. That is,the image 3000 is an image that is presentable at a time point when theoutput instruction is received.

For example, the output image may be only a presentation image 3010(corresponding to the first image) or the entire image 3000 includingportions other than the presentation image 3010 (presentable images 3020and 3030; corresponding to the second image). That is, the output imagemay be only the image that the user 290 is viewing or the entire imagethat the user 290 can view at the time point. In addition, the imagewith which the user images (the user image of the user 290 who is usingthe virtual reality display apparatus 200 and a user image of anotheruser 290) are combined may be a presentation image 3010 or a portionother than the presentation image 3010. In addition, the image withwhich the user images are combined may be one of the presentation image3010 and the portion other than the presentation image 3010.

In addition, as for the output form, as illustrated in the example ofFIG. 30A, a presentation image 3010 a may be centered, and presentableimages 3020 a and 3030 a may be arranged at the left and right sides ofthe presentation image 3010 a.

In addition, as for the output form, as illustrated in the example ofFIG. 30B, a presentation image 3010 b may be positioned at the left end,and a presentable image 3030 b may be positioned at the right side ofthe presentation image 3010 b.

In addition, as for the output form, as illustrated in the example ofFIG. 30C, a presentation image 3010 c may be positioned at the rightend, and a presentable image 3020 c may be positioned at the left sideof the presentation image 3010 c.

In addition, the output image may be output in another form (e.g., thepresentation image 3010 is disposed slightly to the right side).

In addition, in the examples of FIGS. 30A to 30C, the presentable image(the presentable image 3020 or 3030) is arranged at the left or rightside of the presentation image 3010. Alternatively, the presentableimage may be arranged at the upper or lower side of the presentationimage 3010. For example, the image that may be seen when the user islooking up or down at the time of the output instruction is arranged.That is, the position of the presentation image 3010 (e.g., the positionin the paper for the two-dimensional printer 135) may be determined, andthe presentable image may be arranged around the presentation image3010. The position of the presentation image 3010 may be determined bythe user 290 or according to a predetermined position (e.g., at thecenter).

When the first image (the portion that is being presented) and thesecond image (the portion that is not being presented and is thepresentable image) are output in a panoramic form, only one of the firstimage and the second image may have an image at an edge thereof. Thatis, one of the first image and the second image may be a borderlessimage, and the other may be a bordered image. In this case, when one ofthe first image and the second image is a borderless image, theborderless printing may be performed. For example, when the first imageis a borderless image, the entire image including the second image mayalso be printed borderless. When the second image is a borderless image,the entire image including the first image may also be printedborderless. In addition, the borderless printing may be performed onlywhen both images are borderless images. Also, the bordered printing maybe performed only when both images are bordered images.

In addition, the determination may be made for each side. For example,the borderless printing may be performed only when all sides areborderless. Also, the bordered printing may be performed only when allsides are bordered.

In addition, the setting of the priority of the borderless printing orthe bordered printing may be made changeable. In addition, when aborderless image and a bordered image are mixed, or when a borderlessside and a bordered side are mixed, it may be inquired of the user 290about whether to perform the borderless printing (or whether to performthe bordered printing).

As described above, an image showing the entire 360-degree surroundingsmay not be prepared, that is, an image only up to a specific angle ofthe surroundings may be prepared.

In this case, for the image that is not prepared, a solid image such asa black image which is apparently inadequate to the output may exist inthe second image (the portion that is not being presented) (the solidimage may have a color other than black, e.g., dark blue, or may be ablack-and-white dotted image). In that case, when the output instructionis received, a warning may be notified. In addition, it may be inquiredabout whether to perform the output. For example, a warning such as “Aninadequate image is included” or “An unnecessary image will be outputtogether” may be performed. As a result, for example, an occurrence of adifficulty in viewing the output image may be prevented, and theconsumption amount of ink or toner in printing may be reduced.

In addition, when it is determined that the inadequate solid image isincluded, only the image excluding the inadequate solid image may beautomatically extracted and output. In that case, the setting fordetermining the inadequate image may be determined according to the user290. As an example of the determination of the inadequate image, aportion that is temporarily set as an output area with a proportion of amajority (or another proportion) may be determined to be the inadequateimage. In addition, a function of performing the output excluding thesolid image from either or both of the first image (the portion that isbeing presented) and the second image (the portion that is not beingpresented) may be provided. For example, as illustrated in FIG. 30D, ascreen 3000 d may be presented on the display of the virtual realitydisplay apparatus 200. That is, the screen represents that theproportion which is a determination criteria for each of image planes(an image plane that is being presented and an image plane that is notbeing presented) may be set by an operation of the user 290. Forexample, the screen 3000 d presents an inadequate image processingsetting field 3010 d and an inadequate image determination proportionfield 3020 d. The inadequate image processing setting field 3010 d hasan execution instruction field 3012 d in which an ON button 3014 d andan OFF button 3016 d are provided. When the ON button 3014 d isselected, a process of deleting the inadequate image is performedaccording to the setting in the inadequate image determinationproportion field 3020 d. When the OFF button 3016 d is selected, thedeleting process is not performed. The inadequate image determinationproportion field 3020 d presents a proportion 3022 d to the image planethat is being presented and a proportion 3024 d to the image plane thatis not being presented. When the proportion of the inadequate image tothe image that is being presented is equal to or larger than (or largerthan) the value set in the proportion 3022 d, the process of deletingthe inadequate image from the image that is being presented isperformed. When the proportion of the inadequate image to the image thatis not being presented is equal to or larger than (or larger than) thevalue set by the proportion 3024 d, the process of deleting theinadequate image from the image that is not being presented isperformed. That is, as a result of the deletion, the portion of theinadequate image is not output. In the case of FIG. 30D, when theproportion of the area of the inadequate image to the image plane thatis being presented is equal to or larger than (or larger than) 20%, theinadequate image is not set to be a printing target. Also, when theproportion of the area of the inadequate image to the image plane thatis not being presented is equal to or larger than (or larger than) 50%,the inadequate image is not set to be a printing target. The proportioncan be set for each of the image plane that is being presented and theimage plane that is not being presented. Alternatively, the proportionmay be set only for one of the planes (e.g., the image plane that is notbeing presented) or may be set to a proportion to the entire imageplane.

FIG. 31 is a conceptual module configuration diagram illustrating anexample of the configuration of an image formation instruction module3100. When the output control module 125 performs the control to outputthe image to the two-dimensional printer 135, a process of the imageformation instruction module 3100 may be performed.

The image formation instruction module 3100 designates either theborderless printing or the non-borderless printing with respect to thetwo-dimensional printer 135 capable of performing both of the borderlessprinting and the non-borderless printing (so-called bordered printing).The image formation instruction module 3100 includes a printing datareception module 3105, a printing attribute setting module 3110, and aprinting instruction module 3135 as illustrated in the example of FIG.31.

For example, in a case where the borderless printing mode (setting) andthe non-borderless printing mode (setting) exist, if the user 290 iscaused to set one of the modes each time the printing is performed, thenumber of work steps increases, and as a result, it takes long time toperform the operation. Then, in order to reduce the time, the imageformation instruction module 3100 determines which of the borderlessprinting mode and the non-borderless printing mode is a more effectivesetting, and preferentially sets a mode according to the determinationresult.

The printing data reception module 3105 is connected to an outer edgeinspection module 3115 and an image generation process detection module3120 of the printing attribute setting module 3110, and the printinginstruction module 3135. The printing data reception module 3105receives printing data to be printed by the two-dimensional printer 135,and transfers the printing data to the outer edge inspection module3115, the image generation process detection module 3120, and theprinting instruction module 3135.

The printing attribute setting module 3110 includes the outer edgeinspection module 3115, the image generation process detection module3120, a selection module 3125, and a presentation module 3130. Theprinting attribute setting module 3110 is connected to the printinginstruction module 3135. The printing attribute setting module 3110 setsa printing attribute in a case where the two-dimensional printer 135 iscaused to perform the printing. The printing attribute setting module3110 mainly sets one of the borderless printing and the non-borderlessprinting as the printing attribute. In addition, the printing attributesetting module 3110 determines whether the two-dimensional printer 135is capable of setting both of the borderless printing and thenon-borderless printing. When it is determined that the two-dimensionalprinter 135 is capable of setting both of the borderless printing andthe non-borderless printing, the respective modules in the printingattribute setting module 3110 are caused to perform processes. When itis determined that the two-dimensional printer 135 is not capable ofsetting both of the borderless printing and the non-borderless printing(when the two-dimensional printer 135 is capable of setting only one ofthe borderless printing and the non-borderless printing), a setting of aprinting attribute in a general printing device (e.g., setting of thenumber of copies, a paper size, and a black-and-white/color printing)may be performed.

The outer edge inspection module 3115 is connected to the printing datareception module 3105 and the selection module 3125. The outer edgeinspection module 3115 inspects whether an image to be printed ispresent at an outer edge of the printing data received by the printingdata reception module 3105. Here, the “outer edge of the printing data”refers to a peripheral portion of the printing data, and is a portioncorresponding to an edge of a two-dimensional recording medium when theprinting data is printed on the two-dimensional recording medium. Thatis, the outer edge of the printing data is determined based on apositional relationship between the area of the printing data and thetwo-dimensional recording medium on which the printing data is printed.

The printing data may not be limited to the rectangular shape. When theprinting data has the rectangular shape, the outer edge refers to edgeportions of the four sides Hereinafter, the description will be givenusing, for example, the rectangular shape. Specifically, the outer edgewill be described later using examples illustrated in FIGS. 34A to 34C.

The image generation process detection module 3120 is connected to theprinting data reception module 3105 and the selection module 3125. Theimage generation process detection module 3120 detects the generationprocess of the printing data received by the printing data receptionmodule 3105. The generation process includes, for example, a processwhere the printing data is generated by a screenshot (the image that theuser 290 is viewing is instructed to be printed; hereinafter, alsoreferred to as screenshot). As for the detection method, for example,when an attribute of the printing data includes the generation processof the image, the generation process may be extracted. In addition, thegeneration process is not limited to the attribute of the printing data.The generation process may be extracted from other data. For example, adevice that generates the printing data (which may be provided in theimage formation instruction module 3100) may detect the generationprocess from an operation to generate the printing data, and thedetected generation process may be received by the image generationprocess detection module 3120. The generation process may be detectedfrom an operation for generating the printing data. In addition, thegeneration process may be detected from the operation log (operationhistory) for generating the printing data.

The selection module 3125 is connected to the outer edge inspectionmodule 3115 and the image generation process detection module 3120. Theselection module 3125 selects either the setting for borderless printingor the setting for non-borderless printing, based on the printing data.

In addition, the selection module 3125 may select either the setting forborderless printing or the setting for non-borderless printing, based onan image at the outer edge of the printing data. Here, the description“based on an image at the outer edge of the printing data” indicates thedetection result by the outer edge inspection module 3115.

In addition, the selection module 3125 may select the setting forborderless printing when an image is present at the outer edge of theprinting data. The description “when an image is present at the outeredge of the printing data” indicates a case where printing data to beprinted is present at the outer edge of the two-dimensional recordingmedium on which printing.

In addition, the selection module 3125 may select the setting fornon-borderless printing when no image is present at the outer edge ofthe printing data.

In addition, the selection module 3125 may select the setting forborderless printing or the setting for non-borderless printing, for eachedge of the printing data. When the printing data has the rectangularshape, the printing setting may be selected for each side (each of thefour sides).

In addition, the selection module 3125 may select either the setting forborderless printing or the setting for non-borderless printing, based onthe generation process of the printing data.

In addition, the selection module 3125 may select the setting forborderless printing when the printing data is the image generated by thescreenshot. In addition, the selection module 3125 may select thesetting for non-borderless printing when the printing data is generatedby a method other than the screenshot (e.g., when printing a manual).

The presentation module 3130 presents the selection result by theselection module 3125. The selection result is either the setting forborderless printing or the setting for non-borderless printing.

In addition, the presentation module 3130 may present the selectionresult by the selection module 3125 to be changeable by an operator.Specifically, the changing operation by the operator corresponds tochanging the setting for borderless printing which is the selectionresult by the selection module 3125 to the setting for non-borderlessprinting, or in reverse, changing the setting for non-borderlessprinting which is the selection result by the selection module 3125 tothe setting for borderless printing.

The printing instruction module 3135 is connected to the printing datareception module 3105 and the printing attribute setting module 3110.According to the setting of the printing attribute by the printingattribute setting module 3110, the printing instruction module 3135generates a printing instruction (also referred to as a printing job) tocause the two-dimensional printer 135 to print the printing datareceived by the printing data reception module 3105, and transfers theprinting instruction to the two-dimensional printer 135.

In addition, when the setting for borderless printing and the settingfor non-borderless printing are mixed with respect to the printing data,the printing instruction module 3135 may generate an image having aleading edge that is set to the setting for non-borderless printing.When the printing data has the rectangular shape, an image having aleading side that is set to the setting for non-borderless printing isgenerated.

In addition, the printing instruction module 3135 may rotate theprinting data so as to generate the image having the leading edge thatis set to the setting for non-borderless. When the printing data has therectangular shape, an image having a leading side that is set to thesetting for non-borderless printing is generated.

Each of FIGS. 32 and 33 is a flowchart illustrating an example of aprocess according to the present exemplary embodiment.

In step S3202, the printing data reception module 3105 receives theprinting instruction.

In step S3204, the printing attribute setting module 3110 determineswhether the printing device is capable of performing theborderless/bordered (borderless printing/non-borderless printing)setting. When it is determined that the printing device is capable ofthe borderless/bordered setting, the process proceeds to step S3206.Otherwise, the process proceeds to step S3226.

In step S3206, the outer edge inspection module 3115 acquires the outeredge of each of the four sides. For example, FIGS. 34A to 34C areexplanatory views illustrating examples of an outer edge of a processingtarget according to the present exemplary embodiment. As illustrated inthe example of FIG. 34A, printing data 3400 includes outer edges 3410,3420, 3430, and 3440. As illustrated in the examples of FIGS. 34B and34C, a width 3415 of each of the outer edges 3410 and 3430 and a width3425 of each of the outer edges 3420 and 3440 correspond to widths ofedge portions when the bordered printing is performed. In the example ofFIG. 34B, the width 3415 of the outer edge 3410 is the same as the width3415 of the outer edge 3430, but the widths may have different values.In addition, in the example of FIG. 34C, the width 3425 of the outeredge 3420 is the same as the width 3425 of the outer edge 3440, but thewidths may have different values.

In step S3208, the outer edge inspection module 3115 determines whetheran image is present at the outer edge. When it is determined that animage is present at the outer edge, the process proceeds to step S3210.Otherwise, the process proceeds to step S3212. In the examples of FIGS.34A to 34C, it may be determined whether an image to be printed ispresent at the outer edges 3410, 3420, 3430, and 3440. In addition, theouter edges 3410, 3420, 3430, and 3440 may be areas in thetwo-dimensional recording medium on which printing is performed.

In step S3210, the selection module 3125 sets the side in interest tothe borderless printing.

In step S3212, the selection module 3125 sets the side in interest tothe non-borderless printing.

In step S3214, the selection module 3125 determines whether the settingis performed for all the sides. When it is determined that the settingis performed for all the sides, the process proceeds to step S3216.Otherwise, the process returns to step S3208.

In step S3216, the presentation module 3130 presents the setting result.For example, a presentation illustrated in FIG. 35 or 36 is performed.

FIG. 35 is an explanatory view illustrating an examples of apresentation of a screen 3500 according to the exemplary embodiment.FIG. 35 illustrates an example of a presentation in a case where all thesides are set to the non-borderless printing.

The screen 3500 displays the paper size designation field 3510, theprint orientation designation field 3520, the number of copiesdesignation field 3530, and the borderless printing designation field3540. Since all the sides are set to the non-borderless printing,“perform borderless printing” is not selected in the borderless printingdesignation field 3540.

FIG. 36 is an explanatory view illustrating an examples of apresentation of a screen 3500 according to the exemplary embodiment.FIG. 36 represents an example of a presentation in a case where thesides set to the borderless printing and the sides set to thenon-borderless printing are mixed.

The screen 3500 displays the paper size designation field 3510, theprint orientation designation field 3520, the number of copiesdesignation field 3530, and the borderless printing designation field3640. The borderless printing designation field 3640 displays athumbnail image 3650 of the printing data. The thumbnail image 3650 hasborderless/bordered setting areas 3652, 3654, 3656, and 3658. Here, theborderless/bordered setting area 3652 (the upper side) is set to“borderless,” the borderless/bordered setting area 3654 (the right side)is set to “borderless,” the borderless/bordered setting area 3656 (thelower side) is set to “bordered,” and the borderless/bordered settingarea 3658 (the left side) is set to “bordered.”

In step S3218, the presentation module 3130 changes the settingaccording to an operation by the operator. In the example of FIG. 35,the selection of “perform borderless printing” may be received throughan operation by the user 290 in the borderless printing designationfield 3540. That is, even after it is determined that the “borderedprinting” is appropriate, a change from the “bordered printing” to the“borderless printing” may be performed though the operation by the user290. In the example of FIG. 36, the change between the selection of the“borderless printing” and the selection of “bordered printing” may bereceived for each side through the operation by the user 290. That is,even after it is determined that the “borderless printing” or “borderedprinting” is appropriate, the change from the “bordered printing” to the“borderless printing” or from the “borderless printing” to the “borderedprinting” may be performed for each side through the operation by theuser 290.

In step S3220, the printing instruction module 3135 determines whetherthe setting for borderless printing and the setting for non-borderlessprinting are mixed in one two-dimensional recording medium. When it isdetermined that the setting for borderless printing and the setting fornon-borderless printing are mixed, the process proceeds to step S3222.Otherwise, the process proceeds to step S3226.

In step S3222, the printing instruction module 3135 determines whetherthe side that is set to the setting for non-borderless printing is theleading side. When it is determined that the side is the leading side,the process proceeds to step S3226. Otherwise, the process proceeds tostep S3224. Here, the “leading side” refers to a side on which an imageis formed earliest, in the two-dimensional recording medium on whichprinting is performed.

In step S3224, the printing instruction module 3135 rotates the printingdata such that the side that is set to the setting for non-borderlessprinting becomes the leading side. In a case where the borderlessprinting is performed for the leading end, a contamination of the image(e.g., a contamination caused by the toner extending outward from theedge of the two-dimensional recording medium) may spread over the entiretwo-dimensional recording medium. Thus, the printing data is rotatedsuch that the side that is set to the bordered printing becomes theleading side.

In step S3226, the printing attribute setting module 3110 sets otherattributes. The setting of the other attributes corresponds to thesettings in, for example, the paper size designation field 3510, theprint orientation designation field 3520, and the number of copiesdesignation field 3530 as illustrated in the example of FIG. 35.

In step S3228, the printing instruction module 3135 performs theprinting instruction to the two-dimensional printer 135. For example, aprinting instruction table 3700 is generated and transferred as aprinting job to the two-dimensional printer 135. FIG. 37 is anexplanatory view illustrating an example of the data structure of theprinting instruction table 3700. The printing instruction table 3700includes, for example, a printing instruction field 3710, a printingdata field 3720, a paper size field 3730, a print orientation field3740, a number of copies field 3750, and a borderless printing field3760. The borderless printing field 3760 includes an upper side field3762, a right side field 3764, a lower side field 3766, and a left sidefield 3768.

The printing instruction field 3710 stores the printing instruction. Theprinting data field 3720 stores the printing data to be printed. Thepaper size field 3730 stores a size of paper on which printing isperformed. The print orientation field 3740 stores an orientation ofprinting. The number of copies field 3750 stores the number of copies.The borderless printing field 3760 stores information as to whether theborderless printing is set. The upper side field 3762 stores informationas to whether the upper side is set to the borderless printing. Theright side field 3764 stores information as to whether the right side isset to the borderless printing. The lower side field 3766 storesinformation as to whether the lower side is set to the borderlessprinting. The left side field 3768 stores information as to whether theleft side is set to the borderless printing. In addition, instead of theinformation for each side, information as to whether the entire paper isset to the borderless printing (information indicating that theborderless printing is set if any one side is set to the setting forborderless printing) may be stored.

The two-dimensional printer 135 according to the present exemplaryembodiment has a printing function. Generally, the two-dimensionalprinter 135 corresponds to, for example, a printer, a copying machine,or a multifunction machine (an image processing apparatus having thefunctions of one or more of the printer and the copying machine, andhaving plural functions such as a scanner and a facsimile).

As illustrated in an example of FIG. 38, the two-dimensional printer 135includes an image forming process module 3810 and a borderless controlmodule 3820. In the two-dimensional printer 135, a fixing device forborderless printing or a transfer device for borderless printing isreplaceable. In addition, only the fixing device for borderless printingmay be replaceable, only the transfer device for borderless printing maybe replaceable, or both the fixing device for borderless printing andthe transfer device for borderless printing may be replaceable. Thereplacement (setting or mounting) of the fixing device for borderlessprinting refers to a replacement of a fixing device which is not forborderless printing (a general fixing device, i.e., a fixing device forbordered printing) with a fixing device for borderless printing, or viceversa. In addition, the replacement of the transfer device forborderless printing refers to a replacement of a transfer device whichis not for borderless printing (a general transfer device, i.e., atransfer device for bordered printing) with a transfer device forborderless printing, or vice versa.

The two-dimensional printer 135 is capable of performing the borderlessprinting. When the fixing device for borderless printing and thetransfer device for borderless printing are attached to thetwo-dimensional printer 135, the borderless printing may be performedwith a high image quality. Even when one or more of the fixing devicefor borderless printing and the transfer device for borderless printingare not attached to the two-dimensional printer 135, the borderlessprinting itself may be performed. It is noted that, as compared with acase where both are attached, the image quality may be deteriorated or,for example, a failure of the two-dimensional printer 135 may be caused.In addition, it is difficult to recognize from the outside whether thefixing device for borderless printing and the transfer device forborderless printing are attached to the two-dimensional printer 135. Inaddition, a difference between the fixing device for borderless printingor the transfer device for borderless printing and a general fixingdevice or a general transfer device is found in, for example, a cleaningmechanism.

When it is designated to use the borderless printing function, thetwo-dimensional printer 135 determines whether the fixing device or thetransfer device is for borderless printing. When the fixing device orthe transfer device is not for the borderless printing, a warning isissued. In addition, despite the warning, the borderless printing may beperformed according to the operation by the user 290.

The image forming process module 3810 includes a control module 12. Theimage forming process module 3810 is connected to a borderless printingcontrol module 3825, a borderless printing fixing device detectionmodule 3830, and a borderless printing transfer device detection module3835 of the borderless control module 3820. The image forming processmodule 3810 performs an image forming process in the two-dimensionalprinter 135. Specifically, a printing process is performed according tothe printing instruction provided by the operation of the user 290. Inaddition, when the printing instruction includes the designation of theborderless printing, the borderless control module 3820 is caused toperform the process. In addition, the borderless printing may be set foreach side of the two-dimensional recording medium on which printing isperformed. Accordingly, the setting for borderless printing and thesetting for non-borderless printing may be mixed. In that case, thefixing device for borderless printing or the transfer device forborderless printing may be used.

The control module 12 controls the image forming process module 3810 tocause the image forming process module 3810 to perform the image formingprocess.

The detailed process of the image forming process module 3810 and thecontrol module 12 (especially, the borderless printing process) will bedescribed later using examples of FIGS. 39 to 41C.

The borderless control module 3820 includes the borderless printingcontrol module 3825, the borderless printing fixing device detectionmodule 3830, the borderless printing transfer device detection module3835, a warning module 3840, a borderless image forming process module3845, a printing restriction process module 3850, a borderless printingsoftware confirmation module 3855, a borderless printing softwareintroduction module 3860, and a communication module 3865. Theborderless control module 3820 performs a process for a case where theprinting instruction includes the designation of the borderlessprinting.

The borderless printing control module 3825 is connected to the imageforming process module 3810, the warning module 3840, the borderlessimage forming process module 3845, the printing restriction processmodule 3850, and the borderless printing software confirmation module3855. The borderless printing control module 3825 controls the modulesin the borderless control module 3820 according to an instruction fromthe image forming process module 3810.

The borderless printing fixing device detection module 3830 is connectedto the image forming process module 3810 and the warning module 3840.The borderless printing fixing device detection module 3830 detectswhether the fixing device for borderless printing is provided in theimage forming process module 3810. In addition, a cleaner unit attachedto the fixing device may be detected as the fixing device for borderlessprinting.

The borderless printing transfer device detection module 3835 isconnected to the image forming process module 3810 and the warningmodule 3840. The borderless printing transfer device detection module3835 detects whether the transfer device for borderless printing isprovided in the image forming process module 3810. In addition, acleaner unit attached to the transfer device may be detected as thetransfer device for borderless printing.

The borderless printing fixing device detection module 3830 and theborderless printing transfer device detection module 3835 may make thedetermination based on, for example, whether information (flag orattribute information) indicating that the fixing device for borderlessprinting and the transfer device for borderless printing are set isstored in a predetermined storage area. This storage area may beprovided in a storage unit that the fixing device or the transfer devicehas, or in a storage unit of the two-dimensional printer 135. Inaddition, it may be detected by a sensor whether the fixing device forborderless printing and the transfer device for borderless printing areset. The sensor may be, for example, an optical sensor, a magneticsensor, or a mechanical switch. The sensor is turned ON (or OFF) in acase where the fixing device for borderless printing and the transferdevice for borderless printing are set. The determination may be madeupon receipt of this information. Especially, in a case where thestorage area described above is not provided, the detection may beperformed using the sensor.

The warning module 3840 is connected to the borderless printing controlmodule 3825, the borderless printing fixing device detection module3830, and the borderless printing transfer device detection module 3835.In a case where the fixing device or the transfer device is not forborderless printing when the borderless printing function is used, thewarning module 3840 issues the warning. The expression “when theborderless printing function is used” corresponds to, for example, acase where the printing instruction including the designation of theborderless printing is received from the operation of the user 290 asdescribed above. The expression “in a case where the fixing device orthe transfer device is not for the borderless printing” corresponds to,for example, a case where the borderless printing fixing devicedetection module 3830 does not detect that the fixing device forborderless printing is set, or a case where the borderless printingtransfer device detection module 3835 does not detect that the transferdevice for borderless printing is set. Combinations for the expression“in a case where the fixing device or the transfer device is not for theborderless printing” includes a “case where the fixing device is not forborderless printing,” a “case where the transfer device is not forborderless printing,” and a “case where both of the fixing device andthe transfer device are not for borderless printing.” It is noted thatin a case where the two-dimensional printer 135 itself can perform theborderless printing with the high image quality only by the fixingdevice for borderless printing (a general transfer device rather thanthe transfer device for borderless printing), the combinations may onlyinclude the “case where the fixing device is not for borderlessprinting.” In a case where the borderless printing with the high imagequality may be performed only by the transfer device for borderlessprinting (a general fixing device rather than the fixing device forborderless printing), the combinations may only include the “case wherethe transfer device is not for borderless printing.” Alternatively, in acase where in the two-dimensional printer 135, only the fixing devicefor borderless printing is replaceable (the transfer device is notreplaceable), the combinations may only include the “case where thefixing device is not for borderless printing.” In a case where in thetwo-dimensional printer 135, only the transfer device for borderlessprinting is replaceable (the fixing device is not replaceable), thecombinations may only include the “case where the transfer device is notfor borderless printing.”

In addition to display of warning contents on a display device, thewarning may include outputting as a 3D image, outputting of warningsound (including warning voice) to, for example, a speaker, vibration,and a combination thereof.

The borderless image forming process module 3845 is connected to theborderless printing control module 3825. In a case where the fixingdevice for borderless printing or the transfer device for borderlessprinting is not attached, and the designation of the borderless printingfunction is received, the borderless image forming process module 3845performs an image forming process which is different from that in a casewhere the fixing device for borderless printing and the transfer devicefor borderless printing are attached. As for the determination that “thefixing device for borderless printing or the transfer device forborderless printing is not attached,” as described above, the detectionresults by the borderless printing fixing device detection module 3830and the borderless printing transfer device detection module 3835 may beused. As described above, the “case where the designation of theborderless printing function is received” corresponds to, for example, acase where the printing instruction including the designation of theborderless printing is received from the operation by the user 290.

As the “different image forming process,” the density of an image of aperipheral portion which is an edge may be lowered. The peripheralportion refers to portions of the four sides of paper (portions eachhaving a predetermined width from the edge) and is a portion whereprinting is not performed in the general printing (bordered printing).By lowering the density of the image printed at the peripheral portion,the amount of the toner required to be cleaned is reduced. For example,the density is lowered to 80% of the original density. In addition,rather than uniformly lowering the density of the peripheral portion,the lowering amount of density may be increased toward the edge. Inaddition, rather than lowering the density of the portions of all thefour sides, the density of the edge portion of only the leading endportion of the paper in a transport direction may be lowered, or thedensity of the portions of the four sides such as the side edge portionsof the paper may be selectively lowered. In addition, when the densityof the image of the portions of the four sides is lower than or equal toor lower than a predetermined density, the process of lowering thedensity may not be performed.

In addition, as the “different image forming process,” the cleaning ofthe transfer device or the fixing device may be performed morefrequently than that in a case where the fixing device for borderlessprinting and the transfer device for borderless printing are attached.For example, in a case of the borderless printing, the number of timesof the cleaning of each device may be increased. In order to increasethe number of times of the cleaning, the devices may be caused to onlytransport paper without forming an image thereon after the borderlessprinting (the paper is processed in the transfer device and the fixingdevice so that the residual toner which causes the contamination isadsorbed on the paper). In addition, when the idle rotation withoutforming an image is impossible, the cleaning operation may be performedby forming an image similar to the background color of the paper (whiteimage when the paper is white) or forming a transparent clear image. Inaddition, paper having a size larger than the size of the paper on whichthe borderless printing is performed may be used. This is because theborderless printing prints an image extending outward from the paper, asa printing target. In addition, the cleaning process may be performedfor each paper on which the borderless printing is performed or eachprinting job.

In addition, when the borderless printing is consecutively performed onpapers having the same size, a control may be performed so as not toperform the increasing cleaning process. It should be noted that theincreasing cleaning process is performed after the last printing. Inaddition, when the next borderless printing is performed on paper havinga size smaller than that in the previous borderless printing, a controlmay be performed not to perform the increasing cleaning process. Itshould be noted that the increasing cleaning process is performed afterthe last printing. Meanwhile, when the next borderless printing isperformed on paper having a size larger than that in the previousborderless printing, a control may be performed to perform theincreasing cleaning process.

The printing restriction process module 3850 is connected to theborderless printing control module 3825. When the warning module 3840issues the warning, the printing restriction process module 3850restricts the use of the borderless printing function. The “restrictionon the use of the borderless printing function” may be a restriction onthe number of times of use or a restriction on the user 290. Therestriction on the number of times of use refers to performing a controlnot to permit the use of the borderless printing function when the “useof the borderless printing function” is performed the number of timeswhich is more than or equal to or more than a predetermined thresholdvalue. The restriction on the number of times of use includes, forexample, a restriction on the number of copies, a restriction on thenumber of times of use per paper size, and a restriction on the numberof times of use per white-and-black/color. The restriction on the user290 refers to performing a control to permit only a predetermined user290 to “use the borderless printing function.” The restriction on theuser 290 includes, for example, a specification by a user ID(identification) and a specification by the role of the user 290(specifically, a group leader or a designer). In addition, the number oftimes of use and the user 290 may be combined with each other. Forexample, the number of times of use may be restricted per user ID.

The borderless printing software confirmation module 3855 is connectedto the borderless printing control module 3825 and the borderlessprinting software introduction module 3860. The borderless printingsoftware confirmation module 3855 confirms whether software (program)capable of using the borderless printing is introduced, when the fixingdevice for borderless printing and the transfer device for borderlessprinting are attached. As described above, as for whether the fixingdevice for borderless printing and the transfer device for borderlessprinting are attached (or whether the printer is in a state where thedevices are attached), the detection results by the borderless printingfixing device detection module 3830 and the borderless printing transferdevice detection module 3835 may be used. In addition, in order todetermine whether the software capable of using the borderless printingis introduced, it may be determined whether information (flag orattribute information) indicating that the software is introduced isstored in a predetermined storage area, or a software ID capable ofusing the borderless printing may be acquired from a software storageserver and it may be determined whether the software ID is introduced inthe image forming process module 3810.

The borderless printing software introduction module 3860 is connectedto the borderless printing software confirmation module 3855 and thecommunication module 3865. According to the confirmation result by theborderless printing software confirmation module 3855, the borderlessprinting software introduction module 3860 introduces the software via acommunication line when the software capable of using the borderlessprinting is not introduced. Specifically, the software may be searchedfrom the software storage server by using the model of thetwo-dimensional printer 135 as a search key (the search key may include,e.g., device IDs of the fixing device for borderless printing and thetransfer device for borderless printing).

The communication module 3865 is connected to the borderless printingsoftware introduction module 3860. The communication module 3865communicates with the software storage server. Specifically, accordingto an instruction from the borderless printing software introductionmodule 3860, the communication module 3865 transmits a request for thesoftware capable of using the borderless printing and receives thesoftware.

FIG. 39 is a view schematically illustrating the configuration in theimage forming process module 3810. FIG. 40 is a view illustrating theconfiguration in the vicinity of a position where a secondary transferof the image forming process module 3810 illustrated in FIG. 39 isperformed, and the configuration to control a bias voltage appliedbetween a secondary transfer member and a cleaning member.

In an image forming apparatus which forms a toner image by transferringpowdery toner onto a latent image formed by a difference of anelectrostatic potential, the toner is caused to adhere onto the endlessperipheral surface of a latent image carrying member on which the latentimage is formed so that the toner image is formed. Then, the formedtoner image is transferred directly onto the two-dimensional recordingmedium from the latent image carrying member, or the formed toner imageis primarily transferred from the latent image carrying member onto anintermediate transfer body and secondarily transferred onto thetwo-dimensional recording medium. A transfer member that transfers thetoner image onto the two-dimensional recording medium is generally, forexample, a transfer roller that is in contact with the latent imagecarrying member or the intermediate transfer body and is configured suchthat the endless peripheral surface thereof circularly moves, or atransfer belt wrapped about plural roller-shaped members. This transfermember sandwiches the two-dimensional recording medium delivered to atransfer area which is a position where the transfer member and thelatent image carrying member or the intermediate transfer body face eachother, comes into contact with the back surface of the two-dimensionalrecording medium, and causes the two-dimensional recording medium topass through between the transfer member and the latent image carryingmember or the intermediate transfer body. Then, a transfer bias voltageis applied so that an electric field is formed between the transfermember and the latent image carrying member or the intermediate transferbody, and the toner image is transferred onto the two-dimensionalrecording medium within the electric field.

In such an image forming apparatus, a normal printing is generallyperformed, in which the toner image is transferred while leaving amargin at the outer periphery of the two-dimensional recording medium.However, an apparatus has been developed which is capable of performingthe so-called borderless printing for transferring the toner image ontothe entire surface of the two-dimensional recording medium. In theborderless printing, the toner image is formed in a range larger thanthe size of the two-dimensional recording medium, and the toner imagewhich is full on the entire surface of the two-dimensional recordingmedium and extends outward from the periphery thereof is transferred.Accordingly, when the borderless printing is performed, in the transferarea, the toner extending outward from the two-dimensional recordingmedium is transferred onto the peripheral surface of the transfermember.

In addition, a so-called fogging toner slightly adheres to an areaoutside the area where the toner image is formed, on the latent imagecarrying member. Then, in the apparatus in which the toner image istransferred directly onto the two-dimensional recording medium from thelatent image carrying member, the fogging toner is transferred onto theperipheral surface of the transfer member from the area which does notface the two-dimensional recording medium at the transfer position. Inaddition, in the apparatus in which the toner image is primarilytransferred from the latent image carrying member onto the intermediatetransfer body and secondarily transferred from the intermediate transferbody onto the two-dimensional recording medium, the fogging toner istransferred onto the intermediate transfer body at the primary transferposition, and is transferred onto the peripheral surface of the transfermember from the area which does not face the two-dimensional recordingmedium at the secondary transfer position.

As described above, when the transfer member circularly moves while thetoner adheres to the peripheral surface of the transfer member, thetoner adheres to the back surface of the two-dimensional recordingmedium delivered to the transfer area, and as a result, the back surfaceof the two-dimensional recording medium is contaminated. Accordingly,for example, JP-A-2008-89657 proposes an image forming apparatus inwhich a cleaning device that cleans the peripheral surface of thetransfer member is provided and the toner transferred onto theperipheral surface of the transfer member is removed.

In the transfer area where the latent image carrying member or theintermediate transfer body and the transfer member face each other, theamount of the toner transferred onto the peripheral surface of thetransfer member largely fluctuates depending on whether the normalprinting or the borderless printing is performed. In addition, it may beconsidered that the fluctuation occurs according to a temperature orhumidity. With respect to the fluctuating amount of transferred toner,when the toner is not sufficiently removed from the peripheral surfaceof the transfer member, a contamination occurs on the back surface ofthe two-dimensional recording medium.

The image forming process module 3810 prevents the contamination fromoccurring on the back surface of the two-dimensional recording mediumonto which the toner image is transferred. To this end, a case where thefixing device for borderless printing and the transfer device forborderless printing are set will be described.

The two-dimensional printer 135 is an image forming apparatus that formsa color image using, for example, toner of four colors. Thetwo-dimensional printer 135 includes electrophotographic type imageforming units 10Y, 10M, 10C, and 10K that output images of therespective colors, yellow Y, magenta M, cyan C, and black K, and anintermediate transfer belt 20 that faces the image forming units 10Y,10M, 10C, and 10K. The intermediate transfer belt 20 functions as animage carrier. The intermediate transfer belt 20 is wrapped to face eachimage forming unit 10 such that the peripheral surface of theintermediate transfer belt 20 is circularly driven. A secondary transfermember 24 that performs the secondary transfer is disposed downstream ofthe position where the image forming units 10 faces the intermediatetransfer belt 20 in the circular movement direction of the intermediatetransfer belt 20, so as to face the intermediate transfer belt 20. Thesecondary transfer member 24 functions as a transfer member. A sheetshaped two-dimensional recording medium P is delivered to a secondarytransfer position 30 where the secondary transfer member 24 faces theintermediate transfer belt 20, from a sheet accommodation unit 8 via atransport path 9, and the toner image on the intermediate transfer belt20 is transferred onto the two-dimensional recording medium. A transportdevice 25 and a fixing device 7 are provided downstream of the secondarytransfer position 30 in the transport path of the two-dimensionalrecording medium. The transport device 25 transports the two-dimensionalrecording medium onto which the toner image is transferred. The fixingdevice 7 heats and pressurizes the toner image to fix the toner image tothe two-dimensional recording medium. A discharged paper holding unit(not illustrated) is provided on the further downstream side. Thedischarged paper holding unit holds the two-dimensional recording mediaeach with the toner image fixed thereon in a state of being piled up.

Meanwhile, a cleaning device 29 for the intermediate transfer belt isprovided downstream of the secondary transfer position 30 in thecircular movement direction of the intermediate transfer belt 20. Thecleaning device 29 collects the toner remaining on the intermediatetransfer belt 20 after the secondary transfer. In addition, at theposition facing the endless peripheral surface of the secondary transfermember 24, first and second cleaning members 31 and 32 for the secondarytransfer member are disposed to collect the toner transferred from theintermediate transfer belt 20 onto the secondary transfer member 24 atthe secondary transfer position 30.

In addition, the two-dimensional printer 135 has plural printing modesincluding a normal printing mode M1 for forming a toner image whileleaving a margin at the outer periphery of the two-dimensional recordingmedium, and a borderless printing mode M2 for forming a toner image onthe entire surface of the two-dimensional recording medium. Theseprinting modes are switched by the control module 12 based on data inputfrom an external device or data input by the operator through, forexample, an operation panel.

With respect to the image forming units 10, the image forming unit 10Ythat forms a yellow toner image, the image forming unit 10M that forms amagenta toner image, the image forming unit 10C that forms a cyan tonerimage, and the image forming unit 10K that forms a black toner image arearranged in this order from the upstream side in the circular movementdirection of the intermediate transfer belt 20. Each image forming unit10 includes a photoconductor drum 1 having a surface on which anelectrostatic latent image is to be formed, and is provided, around thephotoconductor drum 1, with a charging device 2 that charges the surfaceof the photoconductor drum 1, a developing device 4 that causes thetoner to be selectively transferred onto the latent image formed on thephotoconductor drum so as to form a toner image, a primary transferroller 5 that primarily transfers the toner image on the photoconductordrum 1 onto the intermediate transfer belt 20, and a cleaning device 6that removes the toner remaining on the photoconductor drum after thetransfer. In addition, an exposure device 3 is provided for eachphotoconductor drum 1 to generate image light based on an image signal,so that the image light is irradiated to the photoconductor drum 1 fromthe upstream side of the position where the developing device 4 facesthe photoconductor drum 1 so as to record an electrostatic latent image.

The photoconductor drum 1 is formed by laminating an organicphotoconductive layer on the peripheral surface of a metal cylindricalmember, and the metal portion is electrically grounded. In addition, abias voltage may be applied thereto.

The charging device 2 includes an electrode wire that is wrapped with agap from the peripheral surface of the photoconductor drum 1 which is anobject to be charged. The charging device 2 charges the surface of thephotoconductor drum 1 by applying a voltage between the electrode wireand the photoconductor drum 1 so as to generate a corona discharge.

In the present exemplary embodiment, the device that performs thecharging by the corona discharge is used, as described above. Meanwhile,a solid discharger or, for example, a roller or blade shaped contact ornon-contact charging device may be used.

The exposure device 3 generates a blinking laser beam based on an imagesignal, and scans the laser beam in the main scanning direction (axialdirection) of the rotating photoconductor drum 1 by a polygon mirror. Asa result, an electrostatic latent image corresponding to the image ofeach color is formed on the surface of each photoconductor drum 1.

The developing device 4 uses a two-component developer containing tonerand a magnetic carrier. The developing device 4 includes a developingroller 4 a at the position facing the photoconductor drum 1, so that thelayer of the two-component developer is formed on the peripheral surfaceof the rotating developing roller 4 a. The toner is transferred from theperipheral surface of the developing roller 4 a onto the photoconductordrum 1 so that the electrostatic latent image is visualized. Inaddition, the toner consumed due to the image formation is replenishedaccording to the consumption amount.

In the present exemplary embodiment, the photoconductor drum 1 ischarged to a negative polarity by the charging device 2, and tonercharged to a negative polarity is transferred onto a portion where thecharged potential is attenuated by the exposure.

The primary transfer roller 5 is disposed for each of the image formingunits 10Y, 10M, 10C, and 10K at the position facing each of thephotoconductor drums 1Y, 1M, 1C, and 1K on the back surface side of theintermediate transfer belt 20. Then, a primary transfer bias voltage isapplied between the primary transfer rollers 5Y, 5M, 5C, and 5K and thephotoconductor drums 1Y, 1M, 1C, and 1K, and the toner image on eachphotoconductor drum is electrostatically transferred onto theintermediate transfer belt 20 at the primary transfer position whereeach primary transfer roller and each photoconductor drum face eachother.

The cleaning device 6 for the photoconductor drum removes the tonerremaining on the photoconductor drum 1 after the transfer, by a cleaningblade disposed in contact with the peripheral surface of thephotoconductor drum 1.

The intermediate transfer belt 20 is formed by making a film shapedmember obtained by laminating plural layers into an endless form. Theintermediate transfer belt 20 functions as an image carrier. Theintermediate transfer belt 20 is wrapped about a driving roller 21 thatis rotatably driven, an adjusting roller 22 that adjusts the bias of theintermediate transfer belt 20 in the width direction thereof, and afacing roller 23 that is supported at the position facing the secondarytransfer member 24, so as to circularly move in the direction of thearrow A illustrated in FIG. 39.

The secondary transfer member 24 is disposed at the position facing thefacing roller 23 across the intermediate transfer belt 20. The secondarytransfer member 24 includes a secondary transfer roller 26, an assistingroller 27, and a secondary transfer belt 28 wrapped about the tworollers. The secondary transfer belt 28 is sandwiched between the facingroller 23 and the secondary transfer roller 26 in a state of overlappingwith the intermediate transfer belt 20, so as to circularly moveaccompanied by the circular driving of the intermediate transfer belt20. In addition, when the two-dimensional recording medium is deliveredbetween the intermediate transfer belt 20 and the secondary transferbelt 28, the two-dimensional recording medium is transported throughtherebetween.

The secondary transfer roller 26 is obtained by forming an outerperipheral layer 26 b made of a rubber to which conductive particles areadded, on the outer peripheral surface of a metal core member 26 a. Inaddition, the facing roller 23 is obtained by forming an outerperipheral layer 23 b on the outer peripheral surface of a metal coremember 23 a, and the outer peripheral layer 23 b may be formed of asingle layer or plural layers.

As illustrated in FIG. 40, a secondary transfer bias voltage is appliedbetween the secondary transfer roller 26 and the facing roller 23 from apower supply 11 for transfer bias, so that a transfer electric field isformed at the secondary transfer position 30.

The fixing device 7 heats and pressurizes the two-dimensional recordingmedium onto which the toner image is transferred at the secondarytransfer position 30, so as to fix the toner image to thetwo-dimensional recording medium. The fixing device 7 includes a heatingroller 7 a equipped with a heating source therein and a pressure roller7 b in pressure-contact with the heating roller 7 a. The two-dimensionalrecording medium onto which the toner image is transferred istransported to the contact portion, and is heated and pressurizedbetween the heating roller 7 a and the pressure roller 7 b which arerotatably driven, so that the toner image is fixed to thetwo-dimensional recording medium. In order to collect the tonertransferred onto the heating roller 7 a and the pressure roller 7 b, acleaning member 41 a is provided on the heating roller 7 a, and acleaning member 41 b is provided on the pressure roller 7 b. Inaddition, the cleaning members 41 a and 41 b perform the cleaning in thetransfer device. In addition, the cleaning members 41 a and 41 b may berollers or blades.

The cleaning device 29 for the intermediate transfer belt removes theresidual toner after the transfer onto the two-dimensional recordingmedium at the secondary transfer position 30, from the peripheralsurface of the intermediate transfer belt 20. The cleaning device 29 forthe intermediate transfer belt includes a cleaning blade in contact withthe peripheral surface of the intermediate transfer belt 20. The toneradhering onto the peripheral surface of the intermediate transfer belt20 is scraped off and removed by the cleaning blade.

The first and second cleaning members 31 and 32 are arranged in contactwith the peripheral surface of the secondary transfer belt 28. Each ofthe cleaning members 31 and 32 is formed by providing brush bristlesradially around a rotary shaft made of a metal. The brush bristles areformed of a resin material mixed with particles for imparting theconductivity. Then, a voltage is applied to the brush bristles from therotary shaft so that an electric field is formed between the brushbristles and the secondary transfer roller 26. That is, a cleaning biasvoltage is applied between the first cleaning member 31 that is incontact with the secondary transfer belt 28 on the upstream side in thecircular movement direction of the secondary transfer belt 28 and theelectrically grounded secondary transfer roller 26, from a firstcleaning bias power supply 33, so that the potential of a positivepolarity side is imparted to the first cleaning member 31. In addition,a cleaning bias voltage is applied between the second cleaning member 32that is in contact with the secondary transfer belt 28 on the downstreamside and the secondary transfer roller 26 from a second cleaning biaspower supply 35, such that the potential of the second cleaning member32 becomes a negative polarity side. Accordingly, the first cleaningmember 31 to which the bias voltage is applied such that the firstcleaning member 31 becomes the positive polarity side usually removesthe toner charged to the negative polarity from the peripheral surfaceof the secondary transfer belt 28, and the second cleaning member 32 towhich the voltage of the negative polarity is applied usually removesthe toner charged to the positive polarity.

In addition, in FIG. 40, the reference numerals 36 and 37 representdropping members that are disposed in contact with the brush bristles ofthe first and second cleaning members 31 and 32 so as to drop the toneradsorbed from the peripheral surface of the secondary transfer belt 28.

The first cleaning member 31 functions as a cleaning member, and thefirst cleaning bias power supply 33 that applies the cleaning biasvoltage to the first cleaning member 31 functions as a cleaning biasapplying unit. The voltage applied from the first cleaning bias powersupply 33 to the first cleaning member is controlled by the controlmodule 12.

In addition to a mode switching module 13 that performs a switching to aprinting mode selected from the plural printing modes of thetwo-dimensional printer 135, the control module 12 further includes acleaning bias control module 14 that controls the cleaning bias voltageapplied to the first cleaning member 31. Further, the control module 12has a function of controlling the operation of the two-dimensionalprinter 135 to form an image on the two-dimensional recording medium.

The mode switching module 13 functions as a printing mode switchingunit, and is configured to select one of the plural printing modes suchas the normal printing mode M1 and the borderless printing mode M2 basedon information input from an external device or information input by theoperator using, for example, an operation panel, and switch a controlsuch that the image according to each mode is formed.

The cleaning bias control module 14 functions as a bias voltagecontroller, and controls a voltage value applied from the first cleaningbias power supply 33 to the first cleaning member 31 based on theprinting mode switched in the mode switching module 13. That is, avoltage adjusting unit 34 of the first cleaning bias power supply 33 isoperated such that when the printing mode is switched to the normalprinting mode M1, a first bias voltage value V1 is applied, and when theprinting mode is switched to the borderless printing mode M2, a secondbias voltage value V2 is applied.

The first and second bias voltage values V1 and V2 are preset and storedin the storage module 15, and the second bias voltage value V2 appliedwhen the borderless printing mode M2 is executed is set such that thepotential difference between the secondary transfer roller 26 and thefirst cleaning member 31 becomes large, as compared with the first biasvoltage value V1 applied when the normal printing mode M1 is executed.

In the present exemplary embodiment, the first and second bias voltagevalues V1 and V2 are preset to constant values. However, the biasvoltage values may be controlled based on, for example, an environmentalcondition such as a temperature or humidity and other conditions, inaddition to the printing mode to be executed. However, when, forexample, the environmental condition is the same, the second biasvoltage value V2 at the time of the borderless printing mode M2 iscontrolled such that the potential difference becomes large, as comparedwith the first bias voltage value V1 at the time of the normal printingmode M1.

The two-dimensional printer 135 operates as follows.

The electrostatic latent image is formed on each of the fourphotoconductor drums 1, and the toner is transferred from the developingdevice 4 so that the toner image is formed. Each toner image istransferred onto the intermediate transfer belt 20 at the positionfacing the primary transfer roller 5, and superimposed on each other onthe intermediate transfer belt 20 so that the color toner image isformed. The toner image is transported to the secondary transferposition 30 by the circular movement of the intermediate transfer belt20, and transferred onto the two-dimensional recording medium P from theintermediate transfer belt 20.

In a case where the image forming operation is performed in the normalprinting mode M1, the toner image is formed in an area smaller than thesize of the two-dimensional recording medium, and transferred at thesecondary transfer position 30 while leaving a margin at the outerperipheral portion of the two-dimensional recording medium. In manycases, the so-called fogging toner slightly adheres to a portion outsidethe range where the toner image is held on the intermediate transferbelt 20, for example, a non-image area between the area where the imageis held and an area where the next image is held. The toner adhering toan area that does not face the two-dimensional recording medium at thesecondary transfer position 30 is transferred onto the secondarytransfer belt 28 at the secondary transfer position 30. The secondarytransfer belt 28 circularly moves and passes through the position facingthe first cleaning member 31 to which the first bias voltage value V1 isapplied and the position facing the second cleaning member 32, so that apart of the toner is removed by the cleaning members 31 and 32. Inaddition, another part of the toner is not removed by the cleaningmembers 31 and 32 and remains on the secondary transfer belt 28.However, since the amount of the toner adhering to the non-image area issmall, a contamination does not immediately occur on the back surface ofthe two-dimensional recording medium.

Meanwhile, in a case where the image formation is performed in theborderless printing mode M2, the toner image is formed in a range largerthan the size of the two-dimensional recording medium. Accordingly, whenthe toner image is transferred onto the two-dimensional recording mediumat the secondary transfer position 30, the toner extends outward fromthe outer peripheral edge of the two-dimensional recording medium, andthe extending toner is transferred onto the secondary transfer belt 28.At this time, the amount of the toner adhering to the secondary transferbelt 28 is remarkably larger than that of the fogging toner at the timeof the normal printing mode. Further, the fogging toner adheres to thesecondary transfer belt 28 from the non-image area, as in the case wherethe normal printing mode M1 is executed. Then, the secondary transferbelt 28 circularly moves and passes through the positions facing thefirst and second cleaning members 31 and 32, so that a part of the toneris removed by the cleaning members 31 and 32. At this time, the secondbias voltage value V2 is applied to the first cleaning member 31 thatmakes the potential difference from the secondary transfer roller 26larger than that when the first bias voltage value V1 is applied, andthe cleaning member 31 becomes the positive polarity side. Accordingly,the large amount of negatively charged toner adhering to the secondarytransfer belt 28 is mostly removed by the first cleaning member 31. Thecleaning members 31 and 32 perform the cleaning in the fixing device. Inaddition, the cleaning members 31 and 32 may be brushes, rollers, orblades.

In a case where the borderless printing mode M2 is executed, if thetoner which extends outward from the outer peripheral edge of thetwo-dimensional recording medium passing through the secondary transferposition 30 and adheres to the secondary transfer belt 28 is not removedby the cleaning operation performed once, the toner may adhere to theback surface of the two-dimensional recording medium and cause the tonercontamination.

FIGS. 41A to 41C are views for explaining a state where a contaminationoccurs on the back surface of the two-dimensional recording medium dueto the toner image formed extending outward from the two-dimensionalrecording medium in the borderless printing.

As illustrated in FIG. 41A, when the borderless printing mode M2 isexecuted, a toner image T1 held on the intermediate transfer belt 20 islarger than the size of the two-dimensional recording medium P, andthus, extends forward from the leading end edge of the two-dimensionalrecording medium P, at the secondary transfer position 30 where thetoner image is transferred onto the interposed two-dimensional recordingmedium P. When this portion passes through the secondary transferposition 30, the portion is transferred onto the secondary transfer belt28 as illustrated in FIG. 41B. Then, the portion passes through thepositions facing the first and second cleaning members 31 and 32, alongwith the circular driving of the secondary transfer belt 28. When thetoner is not fully removed by the cleaning members 31 and 32 and remainson the secondary transfer belt 28, the remaining toner T2 reaches thesecondary transfer position 30 again. When the circumferential length ofthe secondary transfer belt 28 is formed shorter than the length of thetwo-dimensional recording medium P in the transport direction, the rearportion of the two-dimensional recording medium P in the transportdirection still stays at the secondary transfer position 30 at the timewhen the remaining toner T2 reaches the secondary transfer position 30.As a result, the remaining toner T2 adheres to the back surface of thetwo-dimensional recording medium P, as illustrated in FIG. 41C.

Thus, in the case of the borderless printing mode M2, the toner T2 thatextends outward from the head end of the two-dimensional recordingmedium P and adheres to the secondary transfer belt 28 needs to beremoved by passing through the positions facing the first and secondcleaning members 31 and 32 only once, to the extent that the tonercontamination on the back surface of the two-dimensional recordingmedium P is acceptable.

FIG. 42 is a flowchart illustrating an example of a process according tothe present exemplary embodiment (especially, the borderless controlmodule 3820).

In step S4202, the borderless printing control module 3825 determineswhether the borderless printing is designated. When it is determinedthat the borderless printing is designated, the process proceeds to stepS4204. Otherwise, the process proceeds to step S4214.

In step S4204, the borderless printing fixing device detection module3830 detects that the fixing device for borderless printing is attached.

In step S4206, the borderless printing transfer device detection module3835 detects that the transfer device for borderless printing isattached.

In step S4208, the warning module 3840 determines whether both of thefixing device for borderless printing and the transfer device forborderless printing are attached. When it is determined that both areattached, the process proceeds to step S4216. Otherwise, the processproceeds to step S4210.

In step S4210, the warning module 3840 performs the warning process.

In step S4212, the borderless printing restriction process is performed.The detailed process of step S4212 will be described later using theflowchart illustrated in an example of FIG. 44.

In step S4214, the image forming process module 3810 performs the normalprocess. For example, the bordered printing process is performed.

In step S4216, the image forming process module 3810 performs theborderless printing normal process described above.

FIGS. 43A and 43B are explanatory views illustrating an example of aprocess according to the present exemplary embodiment. Especially, FIGS.43A and 43B illustrate an example of the process of step S4210 in theflowchart illustrated in the example of FIG. 42.

In the example illustrated in FIG. 43A, a screen 4300 displays “Thecurrently attached transfer device is not for the borderless printing.Replace it.,” and displays a YES button 4310 and a NO button 4320 in aselectable manner. Then, when the user 290 selects the YES button 4310,a process A 4372 is performed. When the NO button 4320 is selected, thedisplay illustrated in the example of FIG. 43B is performed.

As the process A 4372, the following process is performed: “If there isno problem after the replacement, no error is displayed. Alternatively,a message indicating that the borderless printing function becomesusable is displayed, and the borderless printing function is broughtinto a usable state.” According to the flowchart illustrated in theexample of FIG. 42, the determination that the answer in step S4208 is“Y” is made, and then, the process of step S4216 is performed.

In the example of FIG. 43B, the screen 4300 displays “Do you still wantto use the function despite a danger of a failure or an image qualitydeterioration?,” and displays a YES button 4330 and a NO button 4340 ina selectable manner. Then, when the user 290 selects the YES button4330, a process B 4374 is performed. When the NO button 4340 isselected, a process C 4376 is performed.

As the process B 4374, the following process is performed: “Theborderless printing function is restrictively released. As the‘restrictively’ release, for example, the borderless printing may bepermitted only for the current job or the user 290. When the printingprocess for the current job or by the operation of the user 290 iscompleted, the borderless printing function is brought into the unusablestate.” According to the flowchart illustrated in the example of FIG.42, the process of step S4212 is performed.

As the process C 4376, the following process is performed: “Return tothe home screen. Alternatively, the warning screen is displayed again.”

In addition, when one of the fixing device for borderless printing andthe transfer device for borderless printing is set (the other is notset), the borderless printing may be restrictively released (theborderless printing is permitted). When both are not set, the borderlessprinting may be prohibited.

FIG. 44 is a flowchart illustrating an example of a process by thepresent exemplary embodiment.

In step S4402, the cumulative number of copies in the borderlessprinting is calculated. As described above, for example, the cumulativenumber of copies may be calculated for each user or each paper size. Forexample, the calculation may be performed using a borderless printinglog table 4500. FIG. 45 is an explanatory view illustrating an exampleof a data structure of the borderless printing log table 4500. Theborderless printing log table 4500 has a date/time field 4510, a numberof borderless printing copies field 4520, a paper size field 4530, ablack-and-white/color field 4540, and a user field 4550. The borderlessprinting log table 4500 stores the history (log) of the borderlessprinting in a state where the fixing device for borderless printing orthe transfer device for borderless printing is not set. The number ofborderless printing copies field 4520 has an upper side field 4522, aright side field 4524, a lower side field 4526, and a left side field4528. The date/time field 4510 stores date and time at which theborderless printing is performed. The number of borderless printingcopies field 4520 stores the number of borderless printing copies. Theupper side field 4522 stores the number of borderless printing copies ofthe upper side. The right side field 4524 stores the number ofborderless printing copies of the right side. The lower side field 4526stores the number of borderless printing copies of the lower side. Theleft side field 4528 stores the number of borderless printing copies ofthe left side. In addition, instead of storing the number of borderlessprinting copies for each side, the number of borderless printing copiesfor the entire paper may be stored (the number of borderless printingcopies is counted whenever the borderless printing is performed for evenany one side). The paper size field 4530 stores the paper size in theborderless printing. The black-and-white/color field 4540 storesinformation indicating whether the borderless printing is ablack-and-white printing or color printing. The user field 4550 storesthe user (user ID) who performs the borderless printing.

In step S4404, the designated number of borderless printing copies isextracted. In this process, the number of copies may be counted for eachside.

In step S4406, it is determined whether the permitted number ofborderless printing copies is exceeded. When it is determined that thepermitted number of borderless printing copies is exceeded, the processproceeds to step S4408. Otherwise, the process proceeds to step S4410.In the two-dimensional printer 135, the preset number of copies (thenumber of copies that can be printed borderless in a state where thefixing device for borderless printing or the transfer device forborderless printing is not set) is set as a threshold value. Thisdetermination process may be performed for each side.

In step S4408, a non-permission process is performed. For example, adisplay is performed to indicate that the borderless printing cannot beperformed.

In step S4410, it is determined whether the permitted number ofborderless printing copies for each user is exceeded. When it isdetermined that the permitted number of borderless printing copies foreach user is exceeded, the process proceeds to step S4408. Otherwise,the process proceeds to step S4412. For example, the permitted number ofcopies may be determined using a per-user permitted number of copiestable 4600. FIG. 46 is an explanatory view illustrating an example of adata structure of the per-user permitted number of copies table 4600.The per-user permitted number of copies table 4600 has a user field 4610and a permitted number of borderless printing copies field 4620. Theuser field 4610 stores the user 290. The permitted number of borderlessprinting copies field 4620 stores the permitted number of borderlessprinting copies for the user 290. In this example, the permitted numberof copies is set per user. Alternatively, the permitted number of copiesmay be set according to, for example, each paper size.

When the borderless printing may be designated for each side, thepermitted number of borderless printing copies field 4620 may be thenumber of sides that can be printed borderless. In addition, the numberof sides that can be printed borderless may be set for each of the upperside, right side, lower side, and left side. Then, the determinationprocess of step S4410 may be performed for each side.

In step S4412, a borderless printing image forming process is performed.The detailed process of step S4412 will be described later using theflowchart illustrated in an example of FIG. 47.

FIG. 47 is a flowchart illustrating an example of a process by thepresent exemplary embodiment.

In step S4702, a process of generating a borderless printing image isperformed. The detailed process of step S4702 will be described laterusing the flowchart illustrated in an example of FIG. 48.

In step S4704, a borderless printing process is performed. The detailedprocess of step S4704 will be described later using the flowchartillustrated in an example of FIG. 49.

FIG. 48 is a flowchart illustrating an example of a process by thepresent exemplary embodiment.

In step S4802, a process of specifying a peripheral portion isperformed. For example, a predetermined area (a portion having apredetermined width from an edge) is specified.

In step S4804, a density changing process is performed. For example,rather than uniformly lowering the density of the peripheral portion,the lowering amount of density may be increased toward the edge.

FIG. 49 is a flowchart illustrating an example of a process by thepresent exemplary embodiment.

In step S4902, it is determined whether the transfer device is notattached. When it is determined that the transfer device is notattached, the process proceeds to step S4904. Otherwise, the processproceeds to step S4906.

In step S4904, the number of times of the cleaning of the transferdevice is set.

In step S4906, it is determined whether the fixing device is notattached. When it is determined that the fixing device is not attached,the process proceeds to step S4908. Otherwise, the process proceeds toS4910.

In step S4908, the number of times of the cleaning of the fixing deviceis set.

In step S4910, the borderless printing process is performed.

With reference to FIG. 50, an example of a hardware configuration of thepresent exemplary embodiment (e.g., the information processing apparatus100, the two-dimensional printer 135, and the image formationinstruction module 3100) will be described. The configurationillustrated in FIG. 50 is implemented by, for example, a personalcomputer (PC). FIG. 50 illustrates an example of a hardwareconfiguration including a data reading unit 5017 such as a scanner and adata output unit 5018 such as a printer.

A CPU 5001 is a controller that performs processes according to acomputer program describing an execution sequence of each of the variousmodules described in the above-described exemplary embodiment, that is,the movement detection module 105, the image presentation module 115,the output instruction reception module 120, the output control module125, the output image outputting module 130, the image generation module330, the presentation and detection module 310, the presentation module315, the eyeball detection module 320, the printing data receptionmodule 3105, the printing attribute setting module 3110, the outer edgeinspection module 3115, the image generation process detection module3120, the selection module 3125, the presentation module 3130, theprinting instruction module 3135, the image forming process module 3810,the control module 12, the borderless printing control module 3825, theborderless printing fixing device detection module 3830, the borderlessprinting transfer device detection module 3835, the warning module 3840,the borderless image forming process module 3845, the printingrestriction process module 3850, the borderless printing softwareconfirmation module 3855, the borderless printing software introductionmodule 3860, and the communication module 3865.

A ROM 5002 stores, for example, programs or operation parameters used bythe CPU 5001. A RAM 5003 stores, for example, programs used in theexecution by the CPU 5001 or parameters appropriately varying in theexecution. These components are connected to each other by a host bus5004 configured with, for example, a CPU bus.

The host bus 5004 is connected to an external bus 5006 such as aperipheral component interconnect/interface (PCI) bus via a bridge 5005.

A keyboard 5008 and a pointing device 5009 such as a mouse are devicesoperated by an operator. A display 5010 is, for example, the imagepresentation module 115, a liquid crystal display device, or a cathoderay tube (CRT), and displays various types of information as texts orimage information. In addition, for example, a touch screen having thefunctions of both the pointing device 5009 and the display 5010 may beused. In this case, the function of the keyboard may be implemented bydrawing the keyboard using software (also called, for example, aso-called software keyboard, screen keyboard) on the screen (the touchscreen), without the physical connection as in the keyboard 5008.

A hard disk drive (HDD) 5011 is equipped with a hard disk (which may be,for example, a flash memory) therein, drives the hard disk, and causesthe hard disk to store or play programs or information executed by theCPU 5001. The hard disk implements, for example, the functions of theimage storage module 110A and the user image storage module 110B. Inaddition, the hard disk stores, for example, other various data (e.g.,output image data) and various computer programs.

A drive 5012 reads data or programs stored in a removable recordingmedium 5013 such as a mounted magnetic disk, an optical disc, amagneto-optical disc, or a semiconductor memory, and supplies the dataor programs to an interface 5007, the external bus 5006, the bridge5005, and the RAM 5003 connected via the host bus 5004. In addition, theremovable recording medium 5013 may also be used as a data storage area.

A connection port 5014 is a port for a connection of an externalconnection device 5015, and has a connection portion for, for example, aUSB or IEEE1394. The connection port 5014 is connected to, for example,the CPU 5001 via, for example, the interface 5007, the external bus5006, the bridge 5005, or the host bus 5004. A communication unit 5016is connected to a communication line and performs a process of a datacommunication with an external device. The data reading unit 5017 is,for example, a microphone. The data output unit 5018 is, for example,the two-dimensional printer 135, the three-dimensional printer 140, theelectronic image file generation module 145, or a speaker.

In addition, the hardware configuration of, for example, the informationprocessing apparatus 100 illustrated in FIG. 50 merely represents anexample of a configuration. The present exemplary embodiment is notlimited to the configuration illustrated in FIG. 50, and may be anyconfiguration that can execute the modules described in the presentexemplary embodiment. For example, some of the modules may be configuredwith dedicated hardware (e.g., application specific integrated circuit(ASIC)), and some of the modules may be in the form in which the modulesare present in an external system and connected via a communicationline. In addition, the plural systems illustrated in FIG. 50 may beconnected to each other via a communication line and operated incooperation with each other.

In addition, the programs described above may be provided in a state ofbeing stored in a recording medium, or may be provided by acommunication unit. In that case, for example, the programs describedabove may be construed as a “computer readable recording medium storinga program.”

The “computer readable recording medium storing a program” refers to acomputer readable recording medium storing a program, which is used for,for example, installation, execution, and distribution of a program.

In addition, examples of the recording medium include a digitalversatile disc (DVD) such as “DVD-R, DVD-RW, or DVD-RAM” which is thestandard formulated in the DVD forum, “DVD+R or DVD+RW” which is thestandard formulated in DVD+RW, a compact disc (CD) such as a CD readonly memory (CD-ROM), a CD recordable (CD-R), or a CD rewritable(CD-RW), a Blue ray disc (Blu-ray (registered trademark) disc), amagneto-optical (MO) disc, a flexible disc (FD), a magnetic tape, a harddisk, a ROM, an electrically erasable and rewritable read only memory(EEPROM (registered trademark)), a flash memory, a random access memory(RAM), and a secure digital (SD) memory card.

All or some of the programs described above may be stored in therecording medium above and thus may be, for example, saved ordistributed. In addition, the programs may be transmitted using atransmission medium such as a wired network used in, for example, alocal area network (LAN), a metropolitan area network (MAN), a wide areanetwork (WAN), the Internet, the Intranet, and the Extranet, a wirelesscommunication network, or a combination thereof, or may be carried oncarrier waves.

In addition, the programs described above may be all or parts of otherprograms, or may be stored together with another program in therecording medium. In addition, the programs described above may bedistributed and stored in plural recording media. In addition, theprograms described above may be stored in a compressed or encrypted formas long as the programs may be restored.

In addition, the present exemplary embodiment may be combined with thefollowing image forming apparatus. That is, the two-dimensional printer135 may be the following image forming apparatus. (a) An image formingdevice including: an image carrier that carries a toner image; atransfer member disposed such that a circulatively-moving endlessperipheral surface faces the image carrier, an electric field beingformed between the image carrier and the transfer member, the electricfield that transfers the toner image onto a recording medium passingbetween the image carrier and the transfer member; a cleaning memberdisposed to contact the peripheral surface of the transfer member, thecleaning member that removes a toner adhering to the surface of thetransfer member; a cleaning bias applying unit that applies a cleaningbias voltage between the cleaning member and the transfer member; aprinting mode switching unit that selects and switches one of pluralprinting modes including a borderless printing mode in which the tonerimage is transferred onto the entire surface of the recording medium anda normal printing mode in which the toner image is transferred whileleaving a margin on an outer peripheral portion of the recording medium;and a bias voltage controller that controls such that the cleaning biasvoltage applied by the cleaning bias applying unit is set to a firstbias voltage in the normal printing mode and is set to a second biasvoltage in the borderless printing mode, the second bias voltage makinga potential difference between the cleaning member and the transfermember larger than that when the first bias voltage is applied, whereinwhen the formation of the image in the borderless printing mode iscontinuously executed, plural borderless images are formed until apredetermined condition is met, and then the second bias voltage appliedbetween the cleaning member and the transfer member is switched to thefirst bias voltage so that the peripheral surface of the transfer memberis circulatively driven in a state where the first bias voltage isapplied.

(b) The image forming device according to (a), wherein when theformation of the image in the borderless printing mode is continuouslyexecuted, the second bias voltage is switched to the first bias voltageso that the peripheral surface of the transfer member is circulativelydriven in the state where the first bias voltage is applied, and thenthe first bias voltage is switched to the second bias voltage so thatthe formation of the image in the borderless printing mode is resumed.

The following effects are obtained.

In the image forming device of item (a), as compared with a device notequipped with this configuration, even when the formation of the imagein the borderless printing mode is continuously executed, it is possibleto prevent the rear surface of the recording medium onto which the tonerimage is transferred from being contaminated by toner.

In the image forming device of item (b), as compared with a device notequipped with this configuration, even when the formation of the imagein the borderless printing mode is continuously executed, it is possibleto prevent the rear surface of the recording medium onto which the tonerimage is transferred from being contaminated by toner.

The exemplary embodiment described above may be construed as follows.

For example, the present disclosure has the following object.

A head mounted display or the like is used as one of the VRtechnologies, to interact with mainly the vision among the human sensoryorgans and artificially generate realistic environments.

There is a demand to print an image that is presented by the headmounted display or the like.

The present disclosure may provide an information processing apparatusand an information processing program that, when a device that changes apresented image along with a motion direction of a user receives anoutput instruction, may output an outputtable image.

[A1] An information processing apparatus including:

a controller that, when a device that changes an image presented in afield of view of a user along with a motion direction of the userreceives an output instruction, performs a control to output an imageincluding a first image of an area being presented to the field of viewof the user at a time when the output instruction is received and asecond image outside the area.

[A2] The information processing apparatus according to [A1], wherein thecontroller outputs the image including the first image and the secondimage to a module that generates an electronic image file of the imageincluding the first image and the second image.

[A3] The information processing apparatus according to [A1], wherein thecontroller outputs the image including the first image and the secondimage to a module that generates a three-dimensional object from theimage including the first image and the second image.

[A4] The information processing apparatus according to [A3], whereinwhen the area being presented to the user includes three-dimensionaldata, at least the three-dimensional data is output to an outputdestination.

[A5] The information processing apparatus according to [A1], wherein thecontroller outputs the image including the first image and the secondimage to a module that prints the image including the first image andthe second image on a two-dimensional recording medium.

[A6] The information processing apparatus according to [A5], whereinwhen the output instruction is received, a form of the image to beoutput on the two-dimensional recording medium is caused to be aborderless form.

[A7] The information processing apparatus according to [A5], whereinwhen the output instruction is received, a form of the image to beoutput on the two-dimensional recording medium is determined accordingto whether an output destination is capable of performing borderlessprinting.

[A8] The information processing apparatus according to [A7], whereinwhen the output instruction is received and when the output destinationis capable of performing the borderless printing, the form of the imageto be output on the two-dimensional recording medium is caused to be aborderless form.

[A9] The information processing apparatus according to [A7], whereinwhen the output instruction is received and when the output destinationis incapable of performing the borderless printing, the form of theimage to be output on the two-dimensional recording medium is caused tobe a bordered form.

[A10] The information processing apparatus according to [A1], whereinthe second image is an image that is presentable, but is not included inthe field of view of the user at the time when the output instruction isreceived.

[A11] The information processing apparatus according to [A10], whereinthe second image is an image that is located at a position on any one ormore of a left side, a right side, an upper side, and a lower side ofthe first image.

[A12] The information processing apparatus according to [A11], whereinwhen outputting the image including the first image and the secondimage, the controller performs the output so that the first image andthe second image are distinguished from each other.

[A13] The information processing apparatus according to [A1], whereinthe controller determines in which direction of the first image thesecond image is arranged.

[A14] The information processing apparatus according to [A1], whereinthe controller determines a position of the first image and arranges thesecond image around the position.

[A15] The information processing apparatus according to [A1], whereinwhen an image non-display area exists at an edge of a display area ofthe image presented by the device and when the output instruction isreceived, a bordered image is preferentially output.

[A16] The information processing apparatus according to [A1], whereinwhen an image non-display area does not exist at an edge of a displayarea of the image presented by the device and when the outputinstruction is received, a borderless image is preferentially output.

[A17] The information processing apparatus according to [A1], whereinwhen a borderless image exists in only any one of the first image of thearea that is being presented to the field of view of the user and thesecond image outside the area, a setting of the output is inquired.

[A18] The information processing apparatus according to [A1], whereinwhen a uniform image exists in the second image outside the area of thefield of view of the user, a warning of the output is notified.

[A19] The information processing apparatus according to [A1], whereinwhen an image instructed by the user to be output includes an imageinadequate to the output, the output is performed excluding theinadequate image.

[A20] An information processing program causing a computer to executeinformation processing, the information processing including:

when a device that changes an image presented in a field of view of auser along with a motion direction of the user receives an outputinstruction, performing a control to output an image including a firstimage of an area being presented to the field of view of the user at atime when the output instruction is received and a second image outsidethe area.

The present disclosure described above has the following effects.

With the information processing apparatus of [A1], when a device thatchanges a presented image along with a motion direction of a userreceives an output instruction, it is possible to output the image.

With the information processing apparatus of [A2], it is possible togenerate an electronic image file.

With the information processing apparatus of [A3], it is possible togenerate a three-dimensional object.

With the information processing apparatus of [A4], when an area that auser is seeing includes three-dimensional data, it is possible to outputthe three-dimensional data to an output destination.

With the information processing apparatus of [A5], it is possible toprint an image.

With the information processing apparatus of [A6], it is possible tocause a format of an image to be output on a two-dimensional recordingmedium, to be a borderless format.

With the information processing apparatus of [A7], it is possible todetermine a form of an image to be output on a two-dimensional recordingmedium according to whether an output destination is capable ofperforming a borderless printing.

With the information processing apparatus of [A8], when an outputdestination is capable of performing a borderless printing, it ispossible to cause a form of an image to be output on a two-dimensionalrecording medium, to be a borderless form.

With the information processing apparatus of [A9], when an outputdestination is incapable of performing a borderless printing, it ispossible to cause a form of an image to be output on a two-dimensionalrecording medium, to be a bordered form.

With the information processing apparatus of [A10], the second image iscaused to be an image that is presentable, but is not included in afield of view of a user at a time when an output instruction isreceived.

With the information processing apparatus of [A11], the second image iscaused to be an image that is located at a position on any one or moreof a left side, a right side, an upper side, and a lower side of thefirst image.

With the information processing apparatus of [A12], when outputting theimage including the first image and the second image, it is possible toperform the output so that the first image and the second image aredistinguished from each other.

With the information processing apparatus of [A13], it is possible todetermine in which direction of the first image the second image isarranged.

With the information processing apparatus of [A14], it is possible todetermine a position of the first image and arrange the second imagearound the position.

With the information processing apparatus of [A15], an image non-displayarea exists at an edge of a display area of an image presented by adevice, it is possible to preferentially output a bordered image.

With the information processing apparatus of [A16], no image non-displayarea exists at an edge of a display area of an image presented by adevice, it is possible to preferentially output a borderless image.

With the information processing apparatus of [A17], when a borderlessimage exists in only any one of the first image and the second image, itis possible to inquire a setting of the output.

With the information processing apparatus of [A18], when a uniform imageexists in the second image, it is possible to notify a warning of theoutput.

With the information processing apparatus of [A19], when an imageinstructed by the user to be output includes an image inadequate to theoutput, it is possible to perform the output excluding the inadequateimage.

With the information processing program of [A20], when a device thatchanges a presented image along with a motion direction of a userreceives an output instruction, it is possible to output the image.

In addition, the exemplary embodiments described above may be construedas follows.

For example, the present disclosure has the following object.

A head mounted display or the like is used as one of the virtual reality(VR) technologies, to interact with mainly the vision among the humansensory organs and artificially generate realistic environments.

There is a demand to print an image that is presented by the headmounted display or the like.

The present disclosure may provide an information processing apparatusand an information processing program that, when a device that changes apresented image along with a motion direction of a user receives anoutput instruction of the image, may output the image.

[B1] An information processing apparatus including:

a controller that, when a device that changes an image presented in afield of view of a user along with a motion direction of the userreceives an output instruction of the image, performs a control tooutput an image of an area being presented to the user at a time whenthe output instruction is received.

[B2] The information processing apparatus according to [B1], wherein thecontroller outputs the image to a module that generates an electronicimage file of the image.

[B3] The information processing apparatus according to [B1], wherein thecontroller outputs the image to a module that generates athree-dimensional object from the image.

[B4] The information processing apparatus according to [B3], whereinwhen the area being presented in the field of view of the user includesthree-dimensional data, at least the three-dimensional data is output toan output destination.

[B5] The information processing apparatus according to [B1], wherein thecontroller outputs the image to a module that prints the image on atwo-dimensional recording medium.

[B6] The information processing apparatus according to [B5], whereinwhen the output instruction is received, a form of the image to beoutput on the two-dimensional recording medium is caused to be aborderless form.

[B7] The information processing apparatus according to [B5], whereinwhen the output instruction is received, a form of the image to beoutput on the two-dimensional recording medium is determined accordingto whether an output destination is capable of performing borderlessprinting.

[B8] The information processing apparatus according to [B7], whereinwhen the output instruction is received and when the output destinationis capable of performing the borderless printing, the form of the imageto be output on the two-dimensional recording medium is caused to be aborderless form.

[B9] The information processing apparatus according to [B7], whereinwhen the output instruction is received and when the output destinationis incapable of performing the borderless printing, the form of theimage to be output on the two-dimensional recording medium is caused tobe a bordered form.

[B10] The information processing apparatus according to [B1], whereinwhen an image non-display area exists at an edge of a display area ofthe image presented by the device and when the output instruction isreceived, a bordered image is preferentially output.

[B11] The information processing apparatus according to [B1], whereinwhen an image non-display area does not exist at an edge of a displayarea of the image presented by the device and when the outputinstruction is received, a borderless image is preferentially output.

[B12] An information processing program that causes a computer toexecute information processing, the information processing including:

a controller that when a device that changes an image presented in afield of view of a user along with a motion direction of the userreceives an output instruction of the image, performs a control tooutput an image of an area being presented to the user at a time whenthe output instruction is received.

The present disclosure described above has the following effects.

With the information processing apparatus of [B1], when a device thatchanges a presented image along with a motion direction of a userreceives an output instruction of the image, it is possible to outputthe image.

With the information processing apparatus of [B2], it is possible togenerate an electronic image file of an image.

With the information processing apparatus of [B3], it is possible togenerate a three-dimensional object.

With the information processing apparatus of [B4], when an area that auser is seeing includes three-dimensional data, it is possible to outputthe three-dimensional data to an output destination.

With the information processing apparatus of [B5], it is possible togenerate an image on a two-dimensional recording medium.

With the information processing apparatus of [B6], it is possible tocause a format of an image to be output on a two-dimensional recordingmedium, to be a borderless format.

With the information processing apparatus of [B7], it is possible todetermine a form of an image to be output on a two-dimensional recordingmedium according to whether an output destination is capable ofperforming a borderless printing.

With the information processing apparatus of [B8], when an outputdestination is capable of performing a borderless printing, it ispossible to cause a form of an image to be output on a two-dimensionalrecording medium, to be a borderless form.

With the information processing apparatus of [B9], when an outputdestination is incapable of performing a borderless printing, it ispossible to cause a form of an image to be output on a two-dimensionalrecording medium, to be a bordered form.

With the information processing apparatus of [B10], an image non-displayarea exists at an edge of a display area of an image presented by adevice, it is possible to preferentially output a bordered image.

With the information processing apparatus of [B11], no image non-displayarea exists at an edge of a display area of an image presented by adevice, it is possible to preferentially output a borderless image.

With the information processing program of [B12], when a device thatchanges a presented image along with a motion direction of a userreceives an output instruction of the image, it is possible to outputthe image.

In addition, the exemplary embodiments described above may be construedas follows.

For example, the present disclosure has the following object.

When a printing instruction is given an image forming apparatus capableof performing the borderless printing, either a setting for borderlessprinting or a setting for non-borderless printing is selectable. One ofthe settings is selected by an operator's operation. Since the operatorneeds to perform the selecting operation, a process becomes complicated,as compared with a case where the operation is performed in an imageforming apparatus which is incapable of performing the borderlessprinting.

The present disclosure may provide an image forming instructionapparatus and an image forming instruction program which facilitate anoperation related to the setting for borderless printing when theprinting instruction is given to the image forming apparatus capable ofperforming the borderless printing.

[C1] An image forming instruction apparatus including:

a selector that selects either a setting for borderless printing or asetting for non-borderless printing based on print data.

[C2] The image forming instruction apparatus according to [C1], whereinthe selector selects either the setting for borderless printing or thesetting for non-borderless printing based on an image at an outer edgeof the print data.

[C3] The image forming instruction apparatus according to [C2], whereinthe selector selects the setting for borderless printing when there isan image on the outer edge of the print data.

[C4] The image forming instruction apparatus according to [C2], whereinthe selector selects the setting for non-borderless printing when thereis no image on the outer edge of the print data.

[C5] The image forming instruction apparatus according to [C1], whereinthe selector selects the setting for borderless printing or the settingfor non-borderless printing, for each edge of the print data.

[C6] The image forming instruction apparatus according to [C5], furtherincluding a generator that generates an image having a leading edge thatis set to the setting for non-borderless printing when the setting forborderless printing and the setting for non-borderless printing aremixed in the print data.

[C7] The image forming instruction apparatus according to [C6], whereinthe generator generates the image having the leading edge that is set tothe setting for non-borderless printing, by rotating the print data.

[C8] The image forming instruction apparatus according to [C1], whereinthe selector selects either the setting for borderless printing or thesetting for non-borderless printing based on a generating process of theprint data.

[C9] The image forming instruction apparatus according to [C8], whereinthe selector selects the setting for borderless printing when the printdata is an image generated by taking a screenshot.

[C10] The image forming instruction apparatus according to [C1], furtherincluding:

a presentation unit that presents a selection result obtained by theselector.

[C11] The image forming instruction apparatus according to [C10],wherein the presentation unit presents the selection result so as to bechangeable by an operator.

[C12] An image forming instruction program that causes a computer toexecute an image forming instruction process, the image forminginstruction process including:

selecting either a setting for borderless printing or a setting fornon-borderless printing based on print data.

The present disclosure described above has the following effects.

With the image forming instruction apparatus of [C1], when a printinginstruction is given to an image forming apparatus capable of performingborderless printing, it is possible to facilitate the operation relatedto the setting for borderless printing.

With the image forming instruction apparatus of [C2], it is possible toselect one of the setting for borderless printing and the setting fornon-borderless printing by using the image at the outer edge of theprint data.

With the image forming instruction apparatus of [C3], when there is animage on the outer edge of the print data, it is possible to select thesetting for borderless printing.

With the image forming instruction apparatus of [C4], when there is noimage on the outer edge of the print data, it is possible to select thesetting for non-borderless printing.

With the image forming instruction apparatus of [C5], it is possible toselect the setting for borderless printing or the setting fornon-borderless printing for each edge of the print data.

With the image forming instruction apparatus of [C6], it is possible togenerate an image having a leading edge that is set to the setting fornon-borderless printing when the setting for borderless printing and thesetting for non-borderless printing are mixed in the printing data.

With the image forming instruction apparatus of [C7], it is possible togenerate an image having the leading edge that is set to the setting fornon-borderless printing, by rotating the print data.

With the image forming instruction apparatus of [C8], it is possible toselect one of the setting for borderless printing and the setting fornon-borderless printing based on a process of generating the print data.

With the image forming instruction apparatus of [C9], it is possible toselect the setting for borderless printing when the print data is animage generated by a screenshot.

With the image forming instruction apparatus of [C10], it is possible topresent the selection result.

With the image forming instruction apparatus of [C11], it is possible topresent the selection result so that the selection result can be changedby an operator.

With the image forming instruction program of [C12], when a printinginstruction is given to an image forming apparatus capable of borderlessprinting, it is possible to facilitate the operation related to thesetting for borderless printing.

In addition, the exemplary embodiments described above may be construedas follows. [D1] An image forming apparatus in which a fixing device ora transfer device is replaceable, the image forming apparatus including:

a warning unit that issues a warning when a borderless printing functionis used and when the fixing device or the transfer device is not forborderless printing.

[D2] The image forming apparatus according to [D1], wherein the use ofthe borderless printing function is restricted when the warning isissued.

[D3] The image forming apparatus according to [D2], wherein therestriction on the use of the borderless printing function is arestriction on the number of times of use or a restriction on a user.

[D4] An image forming apparatus including:

an image forming processing unit that, when a fixing device forborderless printing or a transfer device for borderless printing is notattached thereto and when a designation of a borderless printingfunction is received, performs another image forming process differentfrom that in a case where the fixing device for borderless printing andthe transfer device for borderless printing are attached.

[D5] The image forming apparatus according to [D4], wherein the otherimage forming process lowers the density of an image of a peripheralportion which is an edge.

[D6] The image forming apparatus according to [D4], wherein the otherimage forming process executes cleaning of the transfer device or thefixing device more frequently than in the case where the fixing devicefor borderless printing and the transfer device for borderless printingare mounted.

[D7] The image forming apparatus according to any one of [D1] to [D6],further including a checking unit that checks whether or not softwarecapable of using borderless printing is introduced, when the fixingdevice for borderless printing and the transfer device for borderlessprinting are attached.

[D8] The image forming apparatus according to [D7], further including anintroduction unit that, when the software capable of using theborderless printing is not introduced, introduces the software via acommunication line.

[D9] An information processing program that causes a computer in animage forming apparatus in which a fixing device or a transfer device isreplaceable to perform an image forming process, the process includingissuing a warning when a borderless printing function is used and whenthe fixing device or the transfer device is not for borderless printing.

[D10] An information processing program that causes a computer in animage forming apparatus to perform an image forming process, the processincluding:

when a fixing device for borderless printing or a transfer device forborderless printing is not attached and when a designation of aborderless printing function is received, performing another imageforming process different from that in a case where the fixing devicefor borderless printing and the transfer device for borderless printingare attached.

The present disclosure described above has the following effects.

With the image forming apparatus of [D1], when a transfer device and afixing device which are suitable for borderless printing are notattached, it is possible to notify the fact to a user.

With the image forming apparatus of [D2], in a case where the fixingdevice is not for borderless printing or the transfer device is not forborderless printing, it is possible to restrict the use of theborderless printing function.

With the image forming apparatus of [D3], the use of borderless printingcan be restricted according to the number of times of use or a user.

With the image forming apparatus of [D4], it is possible to preventdeterioration in image quality, failure, etc. due to the borderlessprinting.

With the image forming apparatus of [D5], it is possible to reduce theload of cleaning.

With the image forming apparatus of [D6], it is possible to reduce acleaning leakage due to the borderless printing.

With the image forming apparatus of [D7], it is possible to preventsoftware capable of using the borderless printing from not beingintroduced even though a fixing device for borderless printing and atransfer device for borderless printing are attached.

With the image forming apparatus of [D8], when a fixing device forborderless printing and a transfer device for borderless printing areattached, it is possible to introduce software capable of usingborderless printing.

With the information processing program of [D9], when a transfer deviceand a fixing device which are suitable for borderless printing are notattached, it is possible to notify the fact to a user.

With the information processing program of [D10], it is possible toprevent a deterioration in image quality, failure, etc. due toborderless printing.

In addition, the exemplary embodiments described above may be construedas follows. [E1] An image forming apparatus in which a fixing device ora transfer device is replaceable, the image forming apparatus including:

a warning unit that issues a warning when a borderless printing functionis used and when the fixing device or the transfer device is not forborderless printing, wherein when the warning is issued, the number oftimes of use of the borderless printing function or a user isrestricted.

[E2] An image forming apparatus including:

an image forming processing unit that, when a fixing device forborderless printing or a transfer device for borderless printing is notattached thereto and when a designation of a borderless printingfunction is received, performs another image forming process differentfrom that in a case where the fixing device for borderless printing andthe transfer device for borderless printing are attached.

[E3] The image forming apparatus according to [E2], wherein the otherimage forming process lowers the density of an image of a peripheralportion which is an edge.

[E4] The image forming apparatus according to [E2], wherein the otherimage forming process executes cleaning of the transfer device or thefixing device more frequently than in the case where the fixing devicefor borderless printing and the transfer device for borderless printingare mounted.

[E5] The image forming apparatus according to any one of [E1] to [E4],further including a checking unit that checks whether or not softwarecapable of using borderless printing is introduced, when the fixingdevice for borderless printing and the transfer device for borderlessprinting are attached.

[E6] The image forming apparatus according to [E5], further including anintroduction unit that, when the software capable of using theborderless printing is not introduced, introduces the software via acommunication line.

[E7] An information processing program that causes a computer in animage forming apparatus to perform an image forming process, the processincluding:

issuing a warning when a borderless printing function is used and whenthe fixing device or the transfer device is not for borderless printing,wherein when the warning is issued, the number of times of use of theborderless printing function or a user is restricted.

[E8] An information processing program that causes a computer in animage forming apparatus to perform an image forming process, the processincluding:

when a fixing device for borderless printing or a transfer device forborderless printing is not attached and when a designation of aborderless printing function is received, performing another imageforming process different from that in a case where the fixing devicefor borderless printing and the transfer device for borderless printingare attached.

The present disclosure described above has the following effects.

With the image forming apparatus of [E1], when a transfer device and afixing device which are suitable for borderless printing are notattached, it is possible to notify the fact to a user. In addition, theuse of the borderless printing can be restricted according to the numberof times of use or a user.

With the image forming apparatus of [E2], it is possible to preventdeterioration in image quality, failure, etc. due to the borderlessprinting.

With the image forming apparatus of [E3], it is possible to reduce theload of cleaning.

With the image forming apparatus of [E4], it is possible to reduce acleaning leakage due to the borderless printing.

With the image forming apparatus of [E5], it is possible to preventsoftware capable of using the borderless printing from not beingintroduced even though a fixing device for borderless printing and atransfer device for borderless printing are attached.

With the image forming apparatus of [E6], when a fixing device forborderless printing and a transfer device for borderless printing areattached, it is possible to introduce software capable of usingborderless printing.

With the information processing program of [E7], when a transfer deviceand a fixing device which are suitable for borderless printing are notattached, it is possible to notify the fact to a user. In addition, theuse of the borderless printing can be restricted according to the numberof times of use or a user.

With the information processing program of [E8], it is possible toprevent a deterioration in image quality, failure, etc. due toborderless printing.

The foregoing description of the exemplary embodiments of the presentinvention has been provided for the purposes of illustration anddescription. It is not intended to be exhaustive or to limit theinvention to the precise forms disclosed. Obviously, many modificationsand variations will be apparent to practitioners skilled in the art. Theembodiments were chosen and described in order to best explain theprinciples of the invention and its practical applications, therebyenabling others skilled in the art to understand the invention forvarious embodiments and with the various modifications as are suited tothe particular use contemplated. It is intended that the scope of theinvention be defined by the following claims and their equivalents.

What is claimed is:
 1. An information processing apparatus comprising: acontroller that, when a device that changes an image presented in afield of view of a user along with a motion direction of the userreceives an output instruction, performs a control to output an imageincluding a presentation image of an area being presented to the user ata time when the output instruction is received and a user's own image.2. The information processing apparatus according to claim 1, whereinthe controller outputs the image including the presentation image andthe user's own image to a module that generates an electronic image fileof the image including the presentation image and the user's own image.3. The information processing apparatus according to claim 1, whereinthe controller outputs the image including the presentation image andthe user's own image to a module that generates a three-dimensionalobject from the image including the presentation image and the user'sown image.
 4. The information processing apparatus according to claim 3,wherein when the area being presented to the user includesthree-dimensional data, at least the three-dimensional data is output toan output destination.
 5. The information processing apparatus accordingto claim 1, wherein the controller outputs the image including thepresentation image and the user's own image to a module that prints theimage including the presentation image and the user's own image on atwo-dimensional recording medium.
 6. The information processingapparatus according to claim 5, wherein when the output instruction isreceived, a form of the image to be output on the two-dimensionalrecording medium is caused to be a borderless form.
 7. The informationprocessing apparatus according to claim 5, wherein when the outputinstruction is received, a form of the image to be output on thetwo-dimensional recording medium is determined according to whether anoutput destination is capable of performing borderless printing.
 8. Theinformation processing apparatus according to claim 7, wherein when theoutput instruction is received and when the output destination iscapable of performing the borderless printing, the form of the image tobe output on the two-dimensional recording medium is caused to be aborderless form.
 9. The information processing apparatus according toclaim 7, wherein when the output instruction is received and when theoutput destination is incapable of performing the borderless printing,the form of the image to be output on the two-dimensional recordingmedium is caused to be a bordered form.
 10. The information processingapparatus according to claim 1, wherein the controller performs acontrol to output an image including the presentation image, the user'sown image, and a user image of another user.
 11. The informationprocessing apparatus according to claim 10, wherein when there isanother user who is using the same contents as contents being processedin the device, the controller performs the control to output the imageincluding the presentation image, the user's own image, and the userimage of the other user.
 12. The information processing apparatusaccording to claim 10, wherein when the output instruction is receivedand when another user is present nearby, the controller performs thecontrol to output the image including the presentation image, the user'sown image, and the user image of the other user.
 13. The informationprocessing apparatus according to claim 1, wherein when the user movesto a predetermined position in contents being processed in the device,the controller urges the user to make the output instruction ordetermines that the output instruction is received and performs thecontrol of the output.
 14. The information processing apparatusaccording to claim 1, wherein when the output instruction is received,the controller receives a setting change of the user's own image. 15.The information processing apparatus according to claim 14, wherein thesetting change is an arrangement position or angle of the user's ownimage.
 16. The information processing apparatus according to claim 14,wherein the setting change is a facial expression in the user's ownimage.
 17. The information processing apparatus according to claim 1,wherein when performing the output, the controller generates informationfor managing history information of the user and the image to be output.18. The information processing apparatus according to claim 17, whereinthe information is embedded in the image to be output.
 19. Annon-transitory computer readable medium storing a program that causes acomputer to execute information processing, the information processingcomprising: when a device that changes an image presented in a field ofview of a user along with a motion direction of the user receives anoutput instruction, performing a control to output an image including apresentation image of an area being presented to the user at a time whenthe output instruction is received and a user's own image.